These forums are currently read-only due to receiving more spam than actual discussion. Sorry.

It is currently Sat Dec 02, 2017 4:23 pm Advanced search

What is an HTML tokenizer and what does it do?

If you are stuck or have questions regarding HTML or other Web technologies, ask your questions here. No question too dumb!

What is an HTML tokenizer and what does it do?

Postby JAB Creations » Sat Nov 05, 2011 8:52 am

What is an HTML tokenizer? What does it do and how would that be useful?
User avatar
JAB Creations
<aside>
 
Posts: 566
Joined: Tue Mar 13, 2007 4:48 am
Location: Sarasota Florida, USA

Re: What is an HTML tokenizer and what does it do?

Postby zcorpan » Sat Nov 05, 2011 9:57 pm

An HTML tokenizer is part of an HTML parser. To parse HTML, you first tokenize the input stream (a sequence of bytes or characters) into a sequence of tokens, where a token is text, start tag, end tag, doctype, or comment. Then the HTML tree builder looks at the sequence of tokens and builds a DOM tree.
zcorpan
<article>
 
Posts: 807
Joined: Tue Feb 06, 2007 8:29 pm
Location: Sweden

Re: What is an HTML tokenizer and what does it do?

Postby JAB Creations » Sun Nov 06, 2011 1:07 am

So text to DOM tree essentially, thanks Z! :)
User avatar
JAB Creations
<aside>
 
Posts: 566
Joined: Tue Mar 13, 2007 4:48 am
Location: Sarasota Florida, USA


Return to Help & Advice

Who is online

Users browsing this forum: No registered users and 0 guests