Add tokenizer

This commit is contained in:
Augusto Gunsch
2020-11-30 18:44:22 -03:00
commit 10fbaf9a72
9 changed files with 311 additions and 0 deletions

3
.gitattributes vendored Normal file
View File

@@ -0,0 +1,3 @@
*.h linguist-language=C
*.c linguist-language=C
Makefile -linguist-detectable