infix2postfix::Tokenizer Class Reference

#include <llvmexpr/frontend/infix2postfix/Tokenizer.hpp>

Public Member Functions
	Tokenizer (std::string source)
std::vector< Token >	tokenize ()

Detailed Description

Definition at line 31 of file Tokenizer.hpp.

Constructor & Destructor Documentation

Tokenizer()

infix2postfix::Tokenizer::Tokenizer ( std::string source )

explicit

Definition at line 64 of file Tokenizer.cpp.

: source(std::move(source)) {}

Member Function Documentation

tokenize()

std::vector< Token > infix2postfix::Tokenizer::tokenize

(

)

Definition at line 66 of file Tokenizer.cpp.

                                     {
    std::vector<Token> tokens;
    while (peek() != '\0') {
        tokens.push_back(nextToken());
    }
    tokens.push_back(makeToken(TokenType::EndOfFile));
    return tokens;
}

Referenced by convert_infix_to_postfix(), and main().

---

The documentation for this class was generated from the following files:

• llvmexpr/frontend/infix2postfix/Tokenizer.hpp
• llvmexpr/frontend/infix2postfix/Tokenizer.cpp