Introduce input ports.

Ports are the lisp abstraction of files and streams. Actinide ports additionally guarantee a peek operation.

This makes ``tokenize`` (now ``read_token``) callable as a lisp function, as it
takes a port and reads one token from it. This is a substantial refactoring.

As most of the state is now captured by closures, it's no longer practical to
test individual states as readily. However, the top-level tokenizer tests
exercise the full state space.

1 files changed, 0 insertions, 6 deletions

diff --git a/bin/actinide-repl b/bin/actinide-repl
deleted file mode 100755
index 7909d36..0000000
--- a/bin/actinide-repl
+++ /dev/null
@@ -1,6 +0,0 @@
-#!/usr/bin/env python
-
-import sys
-import actinide.tokenizer as at
-
-print(repr(list(at.tokenize(sys.stdin))))