tokenizer.hpp File Reference

#include <string>

Include dependency graph for tokenizer.hpp:

This graph shows which files directly or indirectly include this file:

Go to the source code of this file.

Classes
struct	wfl::tokenizer::token
struct	wfl::tokenizer::token_error

Namespaces
	wfl
	wfl::tokenizer

Typedefs
typedef std::string::const_iterator	wfl::tokenizer::iterator

Enumerations
enum	wfl::tokenizer::TOKEN_TYPE {   wfl::tokenizer::TOKEN_OPERATOR, wfl::tokenizer::TOKEN_STRING_LITERAL, wfl::tokenizer::TOKEN_IDENTIFIER, wfl::tokenizer::TOKEN_INTEGER,   wfl::tokenizer::TOKEN_DECIMAL, wfl::tokenizer::TOKEN_LPARENS, wfl::tokenizer::TOKEN_RPARENS, wfl::tokenizer::TOKEN_LSQUARE,   wfl::tokenizer::TOKEN_RSQUARE, wfl::tokenizer::TOKEN_COMMA, wfl::tokenizer::TOKEN_SEMICOLON, wfl::tokenizer::TOKEN_WHITESPACE,   wfl::tokenizer::TOKEN_EOL, wfl::tokenizer::TOKEN_KEYWORD, wfl::tokenizer::TOKEN_COMMENT, wfl::tokenizer::TOKEN_POINTER }
	TOKEN_TYPE is already defined in a Winnt.h (a windows header which is included under some conditions.) More...

Functions
token	wfl::tokenizer::get_token (iterator &i1, const iterator i2)