infix2postfix::preprocessor_detail::PreprocessorTokenizer Class Reference

Public Member Functions
	PreprocessorTokenizer (std::string_view source)
std::vector< Token >	tokenize ()

Detailed Description

Definition at line 115 of file Preprocessor.cpp.

Constructor & Destructor Documentation

PreprocessorTokenizer()

infix2postfix::preprocessor_detail::PreprocessorTokenizer::PreprocessorTokenizer ( std::string_view source )

inlineexplicit

Definition at line 117 of file Preprocessor.cpp.

: source(source) {}

Member Function Documentation

tokenize()

std::vector< Token > infix2postfix::preprocessor_detail::PreprocessorTokenizer::tokenize ( )

inline

Definition at line 119 of file Preprocessor.cpp.

                                {
        std::vector<Token> tokens;
        while (!eof()) {
            Token tok = nextToken();
            tokens.push_back(tok);
            if (tok.type == TokenType::EndOfFile) {
                break;
            }
        }
        return tokens;
    }

References infix2postfix::preprocessor_detail::Token::type.

Referenced by infix2postfix::Preprocessor::Impl::addPredefinedMacro(), and infix2postfix::Preprocessor::Impl::process().

---

The documentation for this class was generated from the following file:

• llvmexpr/frontend/infix2postfix/Preprocessor.cpp