VapourSynth-llvmexpr
Loading...
Searching...
No Matches
infix2postfix::Tokenizer Class Reference

#include <llvmexpr/frontend/infix2postfix/Tokenizer.hpp>

Public Member Functions

 Tokenizer (std::string source)
std::vector< Tokentokenize ()

Detailed Description

Definition at line 31 of file Tokenizer.hpp.

Constructor & Destructor Documentation

◆ Tokenizer()

infix2postfix::Tokenizer::Tokenizer ( std::string source)
explicit

Definition at line 64 of file Tokenizer.cpp.

64: source(std::move(source)) {}

Member Function Documentation

◆ tokenize()

std::vector< Token > infix2postfix::Tokenizer::tokenize ( )

Definition at line 66 of file Tokenizer.cpp.

66 {
67 std::vector<Token> tokens;
68 while (peek() != '\0') {
69 tokens.push_back(nextToken());
70 }
71 tokens.push_back(makeToken(TokenType::EndOfFile));
72 return tokens;
73}

Referenced by convert_infix_to_postfix(), and main().


The documentation for this class was generated from the following files: