Add escape in strings control to ruby parser.

- Moving lines after themselves didnt work.
- moving empty lines deleted them.
- "w" didnt set state to unmodified in generic buffers.
- in "hl" aligned the numbers (by digits)

ARCHITECTURE.md

@@ -0,0 +1,149 @@
+# Base.
+
+### `PCH`
+
+Brings in all the external and standard headers. <br/>
+Apart from c++std stuff we have:
+- `mruby` and almost all it's subheaders.
+- `pcre2` (For regex.)
+- `grapheme.h` - The suckless libgrapheme (to find utf8 boundaries)
+- `unicode_width.h` - To find terminal width of unicode char's.
+
+*Maybe try removing some of them ive probably stopped using.*
+
+### `definitions.h`
+
+- Defines the `bed` namespace
+- Forward declaration of `BEd` type needed by all.
+- `fatal_error` definition, a msg, code (quits application on being thrown)
+- `ed_error`. just a message (stops the current cycle of the ed repl.)
+
+### `bed.h`
+
+**As this is based heavily on the internals, and so ill look into it at the end.**
+
+# `Internal`
+
+## `Vase`
+
+- This module doesn't depend on any other.
+- It's namespace is `bed::internal::vase`
+- Vase is the module to do with the actual storage and handling of a disk backed immutable and reference counted avl piece tree.
+- It is a O(log n) per edit text datatype.
+
+### `constants.h`
+
+Defines `PETAL_SIZE_MAX` as `32 * 1024`.
+- `PETAL_SIZE_MAX` limits teh size of a petal which makes multiple O(n) in petal searches O(1) as it is now bounded.
+
+### `storage/`
+
+A storage is something that stores the actual text, the text is actually stored in storages which are referenced by the trees.
+
+#### `storage.h`
+
+Defines the virtual `Storage` class.
+It has the methods:
+- `const char *read(uint64_t pos)`: reads text from position `pos` and returns a pointer to it.
+- `uint64_t length()`: returns the length of the storage.
+- `void retain() / release()`: Methods to help with refcounted storages.
+
+#### `original.h`
+
+Defines the `Original` type of storage.
+This is a refcounted storage.
+
+It has the fields:
+- `atomic_uint64_t refs{0}`: refcount
+- `const char *buf`: pointer to the actual text.
+- `uint64_t len`
+- `int fd = -1`: the file descriptor of teh undelying disk storage.
+
+It adds the method `initialize` over the base class.
+
+`src/vase/storage/original.cc`.
+
+The constructor uses `mkstemp` to make a temp file, then unlinks it to hide it from the fs but keeps the fd alive.
+
+`initialize` then `mmap`s the fd into a non modifyable pointer managed by the kernel then closes the fd itself.
+- This is what gives us a pointer to the file contents that the kernel can load and evict from memory as needed, and therefore if we have say a 500MB file loaded, but the cursor is arount 200MB and the user is only editing a couple lines around that, the rest of the file will not be using your memory, it might be loaded but if needed the kernel can evict it.
+
+The call site fills the fd before calling initialze, it cannot be modified after that.
+
+#### `append.h`
+
+Defines the `Append` type of storage.
+This is not actually refcounted, it is to be owned by the application just once and reused all throughout.
+It contains the actively typed stuff.
+
+It has the fields:
+- `const char *buf`: pointer to the actual text.
+- `uint64_t allocated_capacity`: the amount of bytees that can be written to it without needing to increase the size.
+- `uint64_t current_size`: Stores the size of actual text stored in it. (the cursor)
+- `int fd = -1`: the file descriptor of the underlying disk storage.
+
+It has the methods `append` (with 2 overloads) and private `grow` over the base class.
+`retain` and `release` do nothing.
+
+`src/vase/storage/append.cc`.
+
+The constructor uses `mkstemp` an `unlink` similar to the original storage.
+It then `ftruncate`s the file to `2^30` bytes or 1GiB this makes writing 1gb to the file possible but does'nt neccasarily use up 1gb on the disk.
+But when `mmap`ing we set `PROT_READ | PROT_WRITE` and `MAP_SHARED` to be able to write edits to disk.
+
+`grow` works by doubling the capacity `ftruncat`ing the fd to the new capacity and then on `linux` it uses `mremap` to remap to the new file size, but otherwise we `munmap` and `mmap` into the new size.
+
+The append methods append text into the buffer (either a single char or char * + len), they may grow the storage size. (the char*+len version uses memcpy).
+
+### `shard.h`
+
+Defines the actual peice tree.
+
+The tree is a polymorhic set of classes.
+
+The base class `Shard` has:
+- `enum Kind : uint8_t kind`: Branch or Petal.
+- `uint16_t height`: the tree height (for avl balancing.)
+- `atomic_uint32_t refs`: the refcount.
+- `uint64_t length`: the length in bytes of this (sub)tree.
+- `uint64_t lines`: the number of `\n` in this subtree.
+- It starts refcount at 1.
+
+The `Branch` class adds:
+- `Shard *left/right` the subtrees.
+- its constructor takes l, r and sets length/lines `(l->length + r->length)`
+- and height `1 + std::max(l->height, r->height)`
+
+The `Petal` (leaf) class adds:
+- `Storage *` a pointer to the storage used.
+- `uint64_t pos` the position in the storage its text starts at.
+- it takes `(uint64_t length, uint64_t lines, Storage *source, uint64_t pos)`
+- it retains `source`. (usefull for refcounted sotrages.)
+
+A `nullptr` `Shard*` is an empty peice of text (i.e. valid).
+
+`src/internal/vase/shard.cc`: defines a set of static function on the Shard class. (All the applications of it.)
+
+the operations methods are:
+- `retain/release` retain/releases them, if freeing a leaf it also releases the storage and for branches it releases both subtrees. nullptr's are ignored.
+- `balance/rotate_(right/left) and height/balance factor` are for doing simple avl balancing operations.
+- `concat` borrows 2 pointers to `Shard` and returns an owned Shard*.
+- `split` borrows a `Shard` and returns a `pair<Shard*, Shard*>` of 2 owned shards.
+- `merge_leaves` works similar to concat but it tries to merge the middle bit if they have their physical representation in order. for example if i have a shard `hell` and i type the letter `o` and because i'd been typing in order the Append storage will have text `hello` we can merge them into a single petal.
+- `append` similar to concat, but uses merge_leaves, useful for small appends like when typing.
+- `build` takes a pointer to an array of `Shard*` and start and end then makes a single avl balanced `Shard*` out of it it is generally faster than calling concat on each peice when we have many.
+
+Then for building a Shard* in the first place we have:
+- `from_command(const char *cmd)` runs the \0 terminated command string and reads its STDOUT and returns an owned Shard*.
+- `from_file(const std::filesystem::path &path)` reads the file at path.
+- `from_string(const char *data, uint64_t len)` loads the string given into a new storage, (normally inserting text can work by inserting into the append storage but this function loads it into a `OriginalStorage` object.).
+These methods all clip the final newline if it exists.
+And they also create a new `OriginalStorage` object.
+
+### `vase.h`
+
+### `iterators/`
+
+#### `line.h`
+
+#### `petal.h`

Makefile

@@ -36,7 +36,7 @@ CFLAGS_RELEASE :=\
 	-fomit-frame-pointer -DNDEBUG -s \
 	-I./include -I./libs/unicode_width
 
-CFLAGS_DEBUG += $(PCRE_CFLAGS) $(LIBGRAPHEME_CFLAGS) $(MRUBY_CFLAGS) $(C_SANITIZER)
+CFLAGS_DEBUG += $(PCRE_CFLAGS) $(LIBGRAPHEME_CFLAGS) $(MRUBY_CFLAGS)
 CFLAGS_RELEASE += $(PCRE_CFLAGS) $(LIBGRAPHEME_CFLAGS) $(MRUBY_CFLAGS)
 
 UNICODE_SRC := $(wildcard libs/unicode_width/*.c)

README.md

@@ -56,5 +56,7 @@ It should support:
 - Error handling.
 - And more.
 
-Not done yet.
+### TODO:
 
+- Make "g" command work.
+- properly handle escapes for %q ' etc in ruby parser (rn everything is escapable.)

flake.nix

@@ -70,9 +70,8 @@
 
         buildPhase = ''
           make \
-            MRBC=${mruby}/bin/mrbc \
-            MRUBY_CFLAGS=-I${mruby}/include \
-            MRUBY_LIBS=-L${mruby}/lib -lmruby
+            MRUBY_CFLAGS="-I${mruby}/include" \
+            MRUBY_LIBS="-L${mruby}/lib -lmruby"
         '';
 
         installPhase = ''
@@ -110,7 +109,6 @@
           export CC="ccache $CC"
           export CXX="ccache $CXX"
 
-          export MRBC=${mruby}/bin/mrbc
           export MRUBY_CFLAGS=-I${mruby}/include
           export MRUBY_LIBS="-L${mruby}/lib -lmruby"
         '';

include/bed.h

@@ -4,47 +4,55 @@
 #include "internal/buffer/buffer.h"
 #include "internal/functions/functions.h"
 #include "internal/functions/suffixes.h"
-#include "internal/io/command.h"
 #include "internal/io/io.h"
 #include "internal/marks/marks.h"
+#include "internal/scripting/ruby.h"
 #include "internal/theme/theme.h"
-#include "internal/ui/autocomp.h"
+#include "internal/ui/command.h"
+#include "internal/ui/text_mode.h"
 #include "pch.h"
 
 namespace bed {
 struct BEd {
+  internal::scripting::RubyState mrb;
   internal::trie::Trie<internal::functions::Function> functions;
   internal::functions::Function no_op;
   internal::functions::Function eof_op;
   std::array<std::optional<internal::functions::Suffix>, 26> suffixes;
   internal::theme::Theme theme;
-  std::unordered_map<std::string, internal::syntax::Language> languages;
-  internal::io::IO &io;
+  std::unordered_map<std::string, internal::syntax::Language *> languages;
+  internal::io::IO io;
   internal::vase::AppendStorage append{"/tmp"};
+  std::unordered_map<std::string, internal::buffer::Buffer *> buffers;
 
   bool help_mode = false;
-  std::string last_help = "";
   bool prompt_mode = true;
   std::function<std::string(BEd &)> prompt = nullptr;
   bool suppress_mode = false;
+  bool color_mode = false;
+  bool temporary_current = false;
+  std::string last_help = "";
   std::string last_regex = "";
   std::string last_symbol = "";
   std::string last_replacement = "";
+  std::string last_shell = "";
 
-  std::unordered_map<std::string, internal::buffer::Buffer *> buffers;
-
-  internal::buffer::Range prev;
+  internal::buffer::Range prev_1;
+  internal::buffer::Range prev_2;
   internal::marks::MarksEngine marks;
 
-  BEd(std::vector<std::string> args, internal::io::IO &io);
+  BEd(std::vector<std::string> args);
   ~BEd();
 
   internal::buffer::Buffer &buffer(const std::string &);
   internal::buffer::Line &current();
-  void mark(char, internal::buffer::Line);
+  internal::buffer::Range &prev();
+  void mark(uint8_t, internal::buffer::Line);
 
+  void print_help();
   void handle(std::string_view cmd, bool eof);
   void run();
   void suffix_handle(char s);
+  bool escape_command(std::string &cmd, std::string_view filename);
 };
 } // namespace bed

include/definitions.h

@@ -15,17 +15,4 @@ struct fatal_error : std::runtime_error {
 struct ed_error : std::runtime_error {
   ed_error(std::string msg) : std::runtime_error(msg) {}
 };
-
-struct Highlight {
-  enum : uint8_t {
-    None = 0,
-    Bold = 1 << 0,
-    Italic = 1 << 1,
-    Strikethrough = 1 << 2,
-    Underline = 1 << 3,
-  };
-  uint32_t fg;
-  uint32_t bg;
-  uint8_t flags;
-};
 } // namespace bed

include/internal/buffer/buffer.h

@@ -1,74 +1,5 @@
 #pragma once
 
-#include "definitions.h"
-#include "internal/syntax/parser.h"
-#include "internal/syntax/ruby/parser.h"
-#include "internal/theme/theme.h"
-#include "pch.h"
-
-namespace bed::internal::buffer {
-struct Buffer {
-  enum {
-    Unmodified,
-    Modified,
-    Warned
-  } state;
-  std::filesystem::path save_path = "";
-
-  vase::Shard *root;
-
-  std::string name;
-  std::string language;
-  std::optional<syntax::Parser> parser;
-
-  explicit Buffer(std::string name);
-  ~Buffer();
-
-  uint64_t lines();
-  vase::Shard *copy(uint64_t start_line, uint64_t end_line);
-  void substitute(
-    BEd &ctx, uint64_t start_line, uint64_t end_line,
-    std::string &regex, std::string &replacement, std::string &options
-  );
-  void join(BEd &ctx, uint64_t start_line, uint64_t end_line);
-  void remove(BEd &ctx, uint64_t start_line, uint64_t end_line);
-  void append(BEd &ctx, vase::Shard *text, uint64_t line);
-  void print(BEd &ctx, uint64_t start_line, uint64_t end_line);
-  void number_print(BEd &ctx, uint64_t start_line, uint64_t end_line);
-  std::string list_string(std::string_view s);
-};
-
-struct Line {
-  std::string buffername;
-  uint64_t number;
-};
-
-struct Range {
-  std::string buffername;
-  uint64_t start;
-  uint64_t end;
-
-  explicit Range(const Line &a, const Line &b) {
-    if (a.buffername != b.buffername)
-      throw ed_error("Invalid range.");
-    if (a.number > b.number)
-      throw ed_error("Invalid range.");
-    buffername = a.buffername;
-    start = a.number;
-    end = b.number;
-  };
-
-  explicit Range(std::string buffername, uint64_t start, uint64_t end)
-      : buffername(buffername), start(start), end(end) {
-    if (start > end)
-      throw ed_error("Invalid range.");
-  };
-
-  explicit Range() : buffername("default"), start(0), end(0) {};
-};
-
-using Address = std::variant<
-  std::string,
-  buffer::Range,
-  buffer::Line>;
-} // namespace bed::internal::buffer
+#include "./types/clip.h"
+#include "./types/generic.h"
+#include "decl.h"

include/internal/buffer/decl.h

@@ -0,0 +1,148 @@
+#pragma once
+
+#include "definitions.h"
+#include "internal/syntax/parser.h"
+#include "internal/syntax/ruby/parser.h"
+#include "internal/theme/theme.h"
+#include "pch.h"
+
+namespace bed::internal::buffer {
+struct Buffer {
+  enum struct Kind : uint8_t {
+    Generic,
+    History,
+    Clip,
+    Cancel,
+    Shell,
+  } kind;
+
+  enum : uint8_t {
+    Special,
+    Unmodified,
+    Modified,
+    Warned
+  } state;
+
+  std::string name;
+
+  explicit Buffer(std::string name, Kind kind)
+      : kind(kind), state(Unmodified), name(std::move(name)) {};
+  virtual ~Buffer() = default;
+
+  virtual bool waste() = 0;
+  virtual uint64_t lines() = 0;
+  virtual uint64_t bytes() = 0;
+  virtual void set_filename(std::filesystem::path path) = 0;
+  virtual std::filesystem::path filename() = 0;
+  virtual void saved_hook() = 0;
+  virtual void load(BEd &ctx, vase::Shard *text) = 0;
+  virtual vase::Shard *copy(uint64_t start_line, uint64_t end_line) = 0;
+  virtual void substitute(
+    BEd &ctx, uint64_t start_line, uint64_t end_line,
+    std::string &regex, std::string &replacement, std::string &options
+  ) = 0;
+  virtual void join(BEd &ctx, uint64_t start_line, uint64_t end_line) = 0;
+  virtual void remove(BEd &ctx, uint64_t start_line, uint64_t end_line) = 0;
+  virtual void append(BEd &ctx, vase::Shard *text, uint64_t line) = 0;
+  virtual void replace(BEd &ctx, vase::Shard *text, uint64_t start_line, uint64_t end_line) = 0;
+  virtual void print(BEd &ctx, uint64_t start_line, uint64_t end_line) = 0;
+  virtual void number_print(BEd &ctx, uint64_t start_line, uint64_t end_line) = 0;
+  virtual void list_print(BEd &ctx, uint64_t start_line, uint64_t end_line) = 0;
+  virtual uint64_t find_next(std::string_view pattern, uint64_t start) = 0;
+  virtual uint64_t find_prev(std::string_view pattern, uint64_t start) = 0;
+  virtual uint64_t next_closing(uint64_t start) = 0;
+  virtual uint64_t prev_closing(uint64_t start) = 0;
+};
+
+struct Line {
+  std::string buffername;
+  uint64_t number;
+};
+
+struct Range {
+  std::string buffername;
+  uint64_t start;
+  uint64_t end;
+
+  explicit Range(const Line &a, const Line &b) {
+    if (a.buffername != b.buffername)
+      throw ed_error("Invalid range.");
+    if (a.number > b.number)
+      throw ed_error("Invalid range.");
+    buffername = a.buffername;
+    start = a.number;
+    end = b.number;
+  };
+
+  explicit Range(std::string buffername, uint64_t start, uint64_t end)
+      : buffername(buffername), start(start), end(end) {
+    if (start > end)
+      throw ed_error("Invalid range.");
+  };
+
+  explicit Range() : buffername("default"), start(0), end(0) {};
+};
+
+using Address = std::variant<
+  std::string,
+  buffer::Range,
+  buffer::Line>;
+
+inline static std::string list_string(std::string_view s) {
+  uint32_t width = 80;
+  winsize ws{};
+  if (ioctl(STDOUT_FILENO, TIOCGWINSZ, &ws) == 0 && ws.ws_col != 0)
+    width = ws.ws_col;
+  std::string out;
+  out.reserve(s.size());
+  const uint32_t max_width = width > 1 ? width - 1 : 1;
+  uint32_t column = 0;
+  auto append = [&](std::string_view text) {
+    if (column + text.size() > max_width) {
+      out += "\\\n";
+      column = 0;
+    }
+    out += text;
+    column += text.size();
+  };
+  for (unsigned char c : s) {
+    switch (c) {
+    case '\\':
+      append("\\\\");
+      break;
+    case '$':
+      append("\\$");
+      break;
+    case '\a':
+      append("\\a");
+      break;
+    case '\b':
+      append("\\b");
+      break;
+    case '\f':
+      append("\\f");
+      break;
+    case '\r':
+      append("\\r");
+      break;
+    case '\t':
+      append("\\t");
+      break;
+    case '\v':
+      append("\\v");
+      break;
+    default:
+      if (!std::isprint(c)) {
+        char buf[5];
+        std::snprintf(buf, sizeof(buf), "\\%03o", c);
+        append(buf);
+      } else {
+        append(std::string_view((const char *)&c, 1));
+      }
+      break;
+    }
+  }
+  out += '$';
+  return out;
+}
+} // namespace bed::internal::buffer

include/internal/buffer/types/clip.h

@@ -0,0 +1,36 @@
+#pragma once
+
+#include "../decl.h"
+
+namespace bed::internal::buffer {
+struct ClipBuffer : Buffer {
+  ClipBuffer(std::string name)
+      : Buffer(name, Kind::Clip) {};
+  ~ClipBuffer();
+
+  void clip_write(vase::Shard *text);
+  bool waste() override;
+  void saved_hook() override;
+  uint64_t lines() override;
+  uint64_t bytes() override;
+  void load(BEd &ctx, vase::Shard *text) override;
+  void set_filename(std::filesystem::path path) override;
+  std::filesystem::path filename() override;
+  vase::Shard *copy(uint64_t start_line, uint64_t end_line) override;
+  void substitute(
+    BEd &ctx, uint64_t start_line, uint64_t end_line,
+    std::string &regex, std::string &replacement, std::string &options
+  ) override;
+  void join(BEd &ctx, uint64_t start_line, uint64_t end_line) override;
+  void remove(BEd &ctx, uint64_t start_line, uint64_t end_line) override;
+  void append(BEd &ctx, vase::Shard *text, uint64_t line) override;
+  void replace(BEd &ctx, vase::Shard *text, uint64_t start_line, uint64_t end_line) override;
+  void print(BEd &ctx, uint64_t start_line, uint64_t end_line) override;
+  void number_print(BEd &ctx, uint64_t start_line, uint64_t end_line) override;
+  void list_print(BEd &ctx, uint64_t start_line, uint64_t end_line) override;
+  uint64_t next_closing(uint64_t start) override;
+  uint64_t prev_closing(uint64_t start) override;
+  uint64_t find_next(std::string_view pattern, uint64_t start) override;
+  uint64_t find_prev(std::string_view pattern, uint64_t start) override;
+};
+} // namespace bed::internal::buffer

include/internal/buffer/types/generic.h

@@ -0,0 +1,48 @@
+#pragma once
+
+#include "../decl.h"
+#include "readonly.h"
+#include "shard.h"
+
+namespace bed::internal::buffer {
+struct HistoryItem {
+  syntax::ParserSnapshot parse_state;
+  vase::Shard *text;
+  std::chrono::system_clock::time_point timestamp;
+  std::string summary;
+};
+
+struct GenericBuffer : ShardBuffer {
+  uint64_t base_version{0};
+  std::chrono::system_clock::time_point timestamp{std::chrono::system_clock::now()};
+  std::string action{"Created buffer."};
+  std::filesystem::path save_path{};
+  std::vector<HistoryItem> undo_stack;
+  std::vector<HistoryItem> redo_stack;
+
+  GenericBuffer(std::string name)
+      : ShardBuffer(name, nullptr, nullptr, Kind::Generic) {}
+  ~GenericBuffer();
+
+  void language(BEd &ctx, std::string name);
+  void list_history(BEd &ctx);
+  ReadonlyBuffer *get_history(uint64_t version);
+  void snapshot(std::string action);
+  bool undo(BEd &ctx);
+  bool redo(BEd &ctx);
+  uint64_t prune(int);
+  void saved_hook() override;
+  bool waste() override;
+  void load(BEd &ctx, vase::Shard *text) override;
+  void set_filename(std::filesystem::path path) override;
+  std::filesystem::path filename() override;
+  void substitute(
+    BEd &ctx, uint64_t start_line, uint64_t end_line,
+    std::string &regex, std::string &replacement, std::string &options
+  ) override;
+  void join(BEd &ctx, uint64_t start_line, uint64_t end_line) override;
+  void remove(BEd &ctx, uint64_t start_line, uint64_t end_line) override;
+  void append(BEd &ctx, vase::Shard *text, uint64_t line) override;
+  void replace(BEd &ctx, vase::Shard *text, uint64_t start_line, uint64_t end_line) override;
+};
+} // namespace bed::internal::buffer

include/internal/buffer/types/readonly.h

@@ -0,0 +1,42 @@
+#pragma once
+
+#include "../decl.h"
+#include "shard.h"
+
+namespace bed::internal::buffer {
+struct ReadonlyBuffer : ShardBuffer {
+  bool useless = true;
+
+  ReadonlyBuffer(
+    std::string name, vase::Shard *root,
+    const syntax::ParserSnapshot &snapshot
+  ) : ShardBuffer(std::move(name), root, snapshot, Kind::History) {}
+
+  void saved_hook() override {}
+  bool waste() override {
+    return useless;
+  }
+  void load(BEd &, vase::Shard *) override {
+    throw ed_error("This buffer is read-only.");
+  }
+  void set_filename(std::filesystem::path) override {}
+  std::filesystem::path filename() override {
+    return {};
+  }
+  void substitute(BEd &, uint64_t, uint64_t, std::string &, std::string &, std::string &) override {
+    throw ed_error("This buffer is read-only.");
+  }
+  void join(BEd &, uint64_t, uint64_t) override {
+    throw ed_error("This buffer is read-only.");
+  }
+  void remove(BEd &, uint64_t, uint64_t) override {
+    throw ed_error("This buffer is read-only.");
+  }
+  void append(BEd &, vase::Shard *, uint64_t) override {
+    throw ed_error("This buffer is read-only.");
+  }
+  void replace(BEd &, vase::Shard *, uint64_t, uint64_t) override {
+    throw ed_error("This buffer is read-only.");
+  }
+};
+} // namespace bed::internal::buffer

include/internal/buffer/types/shard.h

@@ -0,0 +1,42 @@
+#pragma once
+
+#include "../decl.h"
+
+namespace bed::internal::buffer {
+struct ShardBuffer : Buffer {
+  vase::Shard *root;
+  syntax::ParserSnapshot parse{};
+
+  ShardBuffer(std::string name, vase::Shard *root, syntax::Language *language, Kind kind)
+      : Buffer(std::move(name), kind), root(root) {
+    vase::Shard::retain(root);
+    if (language)
+      parse = syntax::make_parser(root, lines(), language);
+  }
+  ShardBuffer(
+    std::string name,
+    vase::Shard *root,
+    const syntax::ParserSnapshot &snapshot,
+    Kind kind
+  ) : Buffer(std::move(name), kind),
+      root(root),
+      parse(syntax::retain(snapshot)) {
+    vase::Shard::retain(root);
+  }
+  ~ShardBuffer() {
+    vase::Shard::release(root);
+    syntax::release(parse);
+  }
+
+  uint64_t lines() override;
+  uint64_t bytes() override;
+  vase::Shard *copy(uint64_t start_line, uint64_t end_line) override;
+  void print(BEd &ctx, uint64_t start_line, uint64_t end_line) override;
+  void number_print(BEd &ctx, uint64_t start_line, uint64_t end_line) override;
+  void list_print(BEd &ctx, uint64_t start_line, uint64_t end_line) override;
+  uint64_t next_closing(uint64_t start) override;
+  uint64_t prev_closing(uint64_t start) override;
+  uint64_t find_next(std::string_view pattern, uint64_t start) override;
+  uint64_t find_prev(std::string_view pattern, uint64_t start) override;
+};
+} // namespace bed::internal::buffer

include/internal/functions/functions.h

@@ -81,5 +81,6 @@ struct Function {
     handle;
 
   static void register_posix(BEd &ctx);
+  static void register_extented(BEd &ctx);
 };
 } // namespace bed::internal::functions

include/internal/io/command.h

@@ -1,48 +0,0 @@
-#pragma once
-
-#include "internal/io/io.h"
-#include "internal/ui/autocomp.h"
-#include "pch.h"
-
-namespace bed::internal::io {
-struct Token {
-  enum struct Type : uint8_t {
-    TempCurrent,      // @
-    AddressSeperator, // ; ,
-    Address,          // . $ % [ ] ^ ~
-    Offset,           // +N -N + -
-    AddressRegex,     // /re/ ?re?
-    AddressSymbol,    // >s> <s< <s>
-    Number,           // 10
-    Mark,             // 'm
-    RubyFunction,     // (func:arg)
-    RubyArg,
-    Function,
-    Any,
-    Shell,
-    Ruby,
-    File,
-    Regex,
-    Replacement,
-    Suffix
-  } type;
-  uint16_t start;
-  uint16_t end;
-};
-
-struct CommandIO {
-  std::string cmd;
-  uint16_t cursor;
-  std::string prompt;
-  uint16_t start;
-  uint16_t height;
-  uint16_t term_height;
-  uint16_t term_width;
-  BEd &bed;
-  IO &io;
-
-  CommandIO(BEd &, IO &);
-  std::pair<std::string, bool> run();
-  void redraw();
-};
-} // namespace bed::internal::io

include/internal/io/io.h

@@ -2,6 +2,7 @@
 
 #include "definitions.h"
 #include "pch.h"
+#include "tokens.h"
 
 namespace bed::internal::io {
 struct KeyEvent {
@@ -50,12 +51,34 @@ struct KeyEvent {
 };
 
 struct IO {
-  IO();
+  static termios orig_termios;
+  static termios raw_termios;
+  static bool cleaned;
+  static void cleanup();
+  static void enable_raw();
+  static volatile std::atomic_bool resized;
+  static void handle_sigwinch(int);
+  BEd &bed;
+
+  static enum struct Mode {
+    PIPE,
+    TERMINAL
+  } mode;
+
+  std::string pipe_input;
+  std::deque<char> input_queue;
+
+  IO(BEd &);
   ~IO();
 
   IO(const IO &) = delete;
   IO &operator=(const IO &) = delete;
 
+  bool interactive() const {
+    return mode == Mode::TERMINAL;
+  }
+  void apply(const io::Token::Kind &t);
+  void reset();
   void enable_mouse();
   void disable_mouse();
 
@@ -63,21 +86,13 @@ struct IO {
   std::pair<uint16_t, uint16_t> cursor_position();
   void move_cursor(uint16_t row, uint16_t col);
 
-  std::pair<std::string, bool> get_command(BEd &);
-  std::pair<std::string, bool> get_text(BEd &);
+  std::pair<std::string, bool> read_pipe();
 
   KeyEvent read_key();
   void write(const char *, uint64_t);
   void write(std::string_view);
-
-private:
-  static termios orig_termios;
-  static bool cleaned;
-  static void cleanup();
-  static volatile std::atomic_bool resized;
-  static void handle_sigwinch(int);
-
-  std::deque<char> input_queue;
+  void write_line(std::string_view);
+  void run_pty(const std::string &);
 
   KeyEvent::ReadResult get_next_byte(char &out);
   void enqueue_bytes(const std::string &bytes);

include/internal/io/tokens.h

@@ -0,0 +1,99 @@
+#pragma once
+
+#include "definitions.h"
+#include "pch.h"
+
+namespace bed::internal::io {
+struct Token {
+  uint64_t start;
+  uint64_t end;
+  enum Kind : uint8_t {
+    TempCurrent,
+    BufferName,
+    AddressSeperator,
+    AddressSymbol,
+    Number,
+    Mark,
+    RubyFunction,
+    RubyArg,
+    Function,
+    Shell,
+    File,
+    Suffix,
+    Color1,
+    Color2,
+    Color3,
+    Color4,
+    Color5,
+    Warning,
+    Data,
+    Shebang,
+    Comment,
+    Error,
+    String,
+    Escape,
+    Interpolation,
+    Regexp,
+    True,
+    False,
+    Char,
+    Keyword,
+    KeywordOperator,
+    Operator,
+    Namespace,
+    Class,
+    Module,
+    Type,
+    Constant,
+    VariableInstance,
+    VariableGlobal,
+    Annotation,
+    Directive,
+    Label,
+    Brace1,
+    Brace2,
+    Brace3,
+    Brace4,
+    Brace5,
+    Heading1,
+    Heading2,
+    Heading3,
+    Heading4,
+    Heading5,
+    Heading6,
+    Blockquote,
+    List,
+    ListItem,
+    Code,
+    LanguageName,
+    LinkLabel,
+    ImageLabel,
+    Link,
+    Table,
+    TableHeader,
+    Italic,
+    Bold,
+    Underline,
+    Strikethrough,
+    HorizontalRule,
+    Tag,
+    Attribute,
+    CheckDone,
+    CheckNotDone,
+    Count
+  } type;
+};
+
+struct Highlight {
+  enum : uint8_t {
+    None = 0,
+    Bold = 1 << 0,
+    Italic = 1 << 1,
+    Strikethrough = 1 << 2,
+    Underline = 1 << 3,
+  };
+  uint32_t fg;
+  uint32_t bg;
+  uint8_t flags;
+};
+} // namespace bed::internal::io

include/internal/marks/marks.h

@@ -22,7 +22,7 @@ struct MarksEngine {
         continue;
       if (marks[i].number == UINT64_MAX)
         continue;
-      if (marks[i].number >= start)
+      if (marks[i].number > start)
         marks[i].number += count;
     }
   }
@@ -48,8 +48,8 @@ struct MarksEngine {
         continue;
       if (marks[i].number == UINT64_MAX)
         continue;
-      if (marks[i].number >= start) {
-        if (marks[i].number < start + count)
+      if (marks[i].number > start) {
+        if (marks[i].number <= start + count)
           marks[i].number = start;
         else
           marks[i].number -= count;

include/internal/parser/parser.h

@@ -2,7 +2,7 @@
 
 #include "internal/functions/functions.h"
 #include "internal/functions/suffixes.h"
-#include "internal/io/command.h"
+#include "internal/ui/command.h"
 #include "pch.h"
 
 namespace bed::internal::parser {
@@ -65,10 +65,10 @@ struct AddressPromise {
 struct Command {
   bool temp_address{false};
   std::vector<AddressPromise> addresses{};
-  functions::Function *function;
-  functions::Function::Argument argument;
+  functions::Function *function{nullptr};
+  functions::Function::Argument argument{std::monostate()};
   std::vector<AddressPromise> argument_addresses{};
-  functions::Suffix *suffix;
+  functions::Suffix *suffix{nullptr};
 };
 
 struct CompletionContext {
@@ -93,6 +93,9 @@ struct Parser {
     std::vector<io::Token> *tokens, CompletionContext *completion
   );
 
+  void token(io::Token::Kind);
+  void end_token();
+
   char peek(uint16_t = 0); // == \0 if at eof.
   std::string_view peek_str(uint16_t = UINT16_MAX);
   void advance(uint16_t = 1);
@@ -107,7 +110,7 @@ struct Parser {
   void operation();
 
   void parse();
-
+  static std::vector<io::Token> get_highlight(std::string_view cmd, BEd &bed);
   static Command get_command(std::string_view, BEd &);
   static std::vector<AddressPromise> get_addresses(std::string_view cmd, BEd &bed);
 };

include/internal/scripting/ruby.h

@@ -0,0 +1,124 @@
+#pragma once
+
+#include "definitions.h"
+#include "pch.h"
+
+namespace bed::internal::scripting {
+struct RubyState {
+  mrb_state *state = nullptr;
+  int arena = 0;
+
+  explicit RubyState(BEd *ctx) : state(mrb_open()) {
+    if (!state)
+      throw fatal_error("Failed to initialize mruby.", 1);
+    state->ud = ctx;
+    arena = mrb_gc_arena_save(state);
+  }
+
+  ~RubyState() {
+    state->ud = nullptr;
+    if (state) {
+      mrb_gc_arena_restore(state, arena);
+      mrb_full_gc(state);
+      mrb_close(state);
+    }
+  }
+
+  RubyState(const RubyState &) = delete;
+  RubyState &operator=(const RubyState &) = delete;
+};
+
+struct Block {
+  mrb_state *mrb = nullptr;
+  mrb_value proc = mrb_nil_value();
+
+  Block(mrb_state *mrb, mrb_value proc) noexcept
+      : mrb(mrb), proc(proc) {
+    mrb_gc_register(mrb, proc);
+  }
+
+  Block() noexcept = default;
+
+  ~Block() noexcept {
+    if (!mrb_nil_p(proc) && mrb)
+      mrb_gc_unregister(mrb, proc);
+  }
+
+  Block(const Block &other) noexcept
+      : mrb(other.mrb), proc(other.proc) {
+    if (mrb && !mrb_nil_p(proc))
+      mrb_gc_register(mrb, proc);
+  }
+
+  Block &operator=(const Block &other) noexcept {
+    if (this != &other) {
+      if (mrb && !mrb_nil_p(proc))
+        mrb_gc_unregister(mrb, proc);
+      mrb = other.mrb;
+      proc = other.proc;
+      if (mrb && !mrb_nil_p(proc))
+        mrb_gc_register(mrb, proc);
+    }
+    return *this;
+  }
+
+  Block(Block &&other) noexcept
+      : mrb(other.mrb), proc(other.proc) {
+    other.mrb = nullptr;
+    other.proc = mrb_nil_value();
+  }
+
+  Block &operator=(Block &&other) noexcept {
+    if (this != &other) {
+      if (mrb && !mrb_nil_p(proc))
+        mrb_gc_unregister(mrb, proc);
+      mrb = other.mrb;
+      proc = other.proc;
+      other.mrb = nullptr;
+      other.proc = mrb_nil_value();
+    }
+    return *this;
+  }
+
+  void set_proc(mrb_state *mrb_, mrb_value new_proc) {
+    if (!mrb_nil_p(proc) && mrb)
+      mrb_gc_unregister(mrb, proc);
+    mrb = mrb_;
+    proc = new_proc;
+    mrb_gc_register(mrb, proc);
+  }
+
+  mrb_value call(int argc = 0, mrb_value *argv = nullptr) const {
+    if (mrb_nil_p(proc))
+      return mrb_nil_value();
+    mrb_value result = mrb_funcall_argv(mrb, proc, mrb_intern_cstr(mrb, "call"), argc, argv);
+    if (!mrb->exc)
+      return result;
+    mrb_value exc = mrb_obj_value(mrb->exc);
+    mrb_value msg = mrb_funcall(mrb, exc, "message", 0);
+    std::string error;
+    if (mrb_string_p(msg))
+      error.assign(RSTRING_PTR(msg), RSTRING_LEN(msg));
+    auto *fatal_class = mrb_class_get(mrb, "FatalError");
+    if (mrb_obj_is_kind_of(mrb, exc, fatal_class)) {
+      mrb_value code =
+        mrb_iv_get(mrb, exc, mrb_intern_lit(mrb, "@code"));
+      mrb->exc = nullptr;
+      int c = 1;
+      if (mrb_fixnum_p(code))
+        c = mrb_fixnum(code);
+      throw fatal_error(error, c);
+    }
+    auto *ed_class = mrb_class_get(mrb, "EdError");
+    if (mrb_obj_is_kind_of(mrb, exc, ed_class)) {
+      mrb->exc = nullptr;
+      throw ed_error(error);
+    }
+    mrb->exc = nullptr;
+    throw ed_error("Ruby Exception: " + error);
+  }
+};
+
+void register_basic(BEd &ctx);
+std::string run(BEd &ctx, const std::string &str);
+}; // namespace bed::internal::scripting

include/internal/syntax/decl.h

@@ -1,73 +1,11 @@
 #pragma once
 
+#include "internal/io/tokens.h"
 #include "internal/trie/trie.h"
+#include "internal/vase/vase.h"
 #include "pch.h"
 
 namespace bed::internal::syntax {
-struct Token {
-  uint32_t start;
-  uint32_t end;
-  enum Kind : uint8_t {
-    Data,
-    Shebang,
-    Comment,
-    Error,
-    String,
-    Escape,
-    Interpolation,
-    Regexp,
-    Number,
-    True,
-    False,
-    Char,
-    Keyword,
-    KeywordOperator,
-    Operator,
-    Function,
-    Namespace,
-    Class,
-    Module,
-    Type,
-    Constant,
-    VariableInstance,
-    VariableGlobal,
-    Annotation,
-    Directive,
-    Label,
-    Brace1,
-    Brace2,
-    Brace3,
-    Brace4,
-    Brace5,
-    Heading1,
-    Heading2,
-    Heading3,
-    Heading4,
-    Heading5,
-    Heading6,
-    Blockquote,
-    List,
-    ListItem,
-    Code,
-    LanguageName,
-    LinkLabel,
-    ImageLabel,
-    Link,
-    Table,
-    TableHeader,
-    Italic,
-    Bold,
-    Underline,
-    Strikethrough,
-    HorizontalRule,
-    Tag,
-    Attribute,
-    CheckDone,
-    CheckNotDone,
-    Count
-  } type;
-};
-
 struct ParseEvent {
   uint8_t closing;
   ParseEvent(uint8_t t) : closing(t) {}
@@ -75,7 +13,11 @@ struct ParseEvent {
 
 struct Language {
   std::function<void *()> none_state;
-  std::function<void(void **, std::string_view, bool, std::vector<Token> *, std::vector<ParseEvent> *)> parse;
+  std::function<void(
+    void **, std::string_view,
+    bool, std::vector<io::Token> *, std::vector<ParseEvent> *
+  )>
+    parse;
   std::function<void *(void *)> copy;
   std::function<bool(void *, void *)> equal;
   std::function<void(void *)> destroy;
@@ -85,35 +27,136 @@ struct ParseState {
   static constexpr uint64_t BRANCH_BIT = 1ull << 63;
   static constexpr uint64_t LINES_MASK = ~BRANCH_BIT;
   uint64_t header;
+  uint16_t height;
+  std::atomic_uint16_t refs;
   bool is_branch() const {
     return header & BRANCH_BIT;
   }
   uint64_t lines() const {
     return header & LINES_MASK;
   }
+  explicit ParseState(bool branch, uint64_t lines, uint16_t height)
+      : height(height), refs(1) {
+    header = lines;
+    header |= branch * BRANCH_BIT;
+  };
+  static void retain(ParseState *node);
+  static void release(Language &lang, ParseState *node);
+  static ParseState *build(Language &lang, ParseState **pieces, uint64_t lo, uint64_t hi);
+  static ParseState *splice(
+    Language &lang, ParseState *node, vase::Shard *vase,
+    uint64_t line, uint64_t original, uint64_t final
+  );
+  static ParseState *concat(Language &lang, ParseState *a, ParseState *b);
+  static void *state_before(Language &lang, ParseState *root, vase::Shard *vase, uint64_t line);
 };
 
 struct ParseStateBranch : ParseState {
   ParseState *left;
   ParseState *right;
+  ParseStateBranch(ParseState *l, ParseState *r)
+      : ParseState(
+          true, l->lines() + r->lines(),
+          1 + std::max(l->height, r->height)
+        ),
+        left(l), right(r) {
+    retain(l);
+    retain(r);
+  }
 };
 
 struct ParseStateLeaf : ParseState {
-  void *state;
-  uint32_t n;
-  uint32_t cap;
-  uint16_t *blocks;
+  static constexpr uint64_t MAX_CHUNK = 512;
+  uint32_t n{0};
   static constexpr uint16_t IS_CLOSING = 0x8000;
   static constexpr uint16_t LINE_MASK = 0x7fff;
+  uint16_t *blocks{nullptr};
+  void *state;
+  ParseStateLeaf(void *state, uint64_t lines, uint32_t n, uint16_t *blocks_)
+      : ParseState(false, lines, 1), n(n), state(state) {
+    blocks = (uint16_t *)malloc(sizeof(uint16_t) * n);
+    memcpy(blocks, blocks_, sizeof(uint16_t) * n);
+  };
+};
+
+struct ParsePieceBuilder {
+  Language &lang;
+  std::vector<ParseState *> pieces;
+  std::vector<uint16_t> blocks;
+  void *piece_state{nullptr};
+  void *prev_state{nullptr};
+  uint64_t chunk_start{0};
+  uint64_t chunk_lines{0};
+  ParsePieceBuilder(Language &lang, uint64_t first_line, void *entry_state)
+      : lang(lang), chunk_start(first_line) {
+    prev_state = lang.copy(entry_state);
+  }
+  ~ParsePieceBuilder() {
+    if (prev_state)
+      lang.destroy(prev_state);
+    if (piece_state)
+      lang.destroy(piece_state);
+  }
+  ParsePieceBuilder(const ParsePieceBuilder &) = delete;
+  ParsePieceBuilder &operator=(const ParsePieceBuilder &) = delete;
+  void add(void *state, uint64_t line, const std::vector<ParseEvent> &events) {
+    if (chunk_lines == 0) {
+      chunk_start = line;
+      piece_state = lang.copy(prev_state);
+    }
+    for (const auto &ev : events) {
+      blocks.push_back(
+        (ev.closing ? ParseStateLeaf::IS_CLOSING : 0)
+        | (line - chunk_start)
+      );
+    }
+    ++chunk_lines;
+    if (prev_state)
+      lang.destroy(prev_state);
+    prev_state = lang.copy(state);
+    if (chunk_lines == ParseStateLeaf::MAX_CHUNK)
+      flush();
+  }
+  void flush() {
+    if (chunk_lines == 0)
+      return;
+    pieces.push_back(new ParseStateLeaf(
+      piece_state,
+      chunk_lines,
+      blocks.size(),
+      blocks.data()
+    ));
+    piece_state = nullptr;
+    blocks.clear();
+    chunk_lines = 0;
+  }
+  ParseState *finish() {
+    flush();
+    if (pieces.empty())
+      return nullptr;
+    ParseState *root = ParseState::build(lang, pieces.data(), 0, pieces.size());
+    pieces.clear();
+    return root;
+  }
 };
 
 struct TreeCursor {
+  Language &lang;
+  ParseState *root;
   ParseStateLeaf *leaf = nullptr;
   ParseStateBranch *stack[64];
   uint8_t depth = 0;
   bool went_left[64];
-  TreeCursor(ParseState *root, uint64_t target_line, uint64_t *relative);
+  TreeCursor(
+    Language &lang, ParseState *root,
+    uint64_t target_line, uint64_t *relative
+  );
+  ~TreeCursor();
+  TreeCursor(const TreeCursor &) = delete;
+  TreeCursor &operator=(const TreeCursor &) = delete;
   void next();
   void prev();
+  ParseState *prefix();
+  ParseState *suffix();
 };
 } // namespace bed::internal::syntax

include/internal/syntax/miniparser.h

@@ -0,0 +1,21 @@
+#pragma once
+
+#include "decl.h"
+
+namespace bed::internal::syntax {
+struct MiniParser {
+  Language ⟨
+  void *start_state;
+  std::vector<std::pair<void *, std::vector<io::Token>>> lines;
+
+  explicit MiniParser(Language &lang, vase::Shard *vase, void *initial_state);
+  ~MiniParser();
+
+  MiniParser(const MiniParser &) = delete;
+  MiniParser &operator=(const MiniParser &) = delete;
+
+  void dirty(vase::Shard *vase, uint64_t start, uint64_t count);
+  void insert(vase::Shard *vase, uint64_t start, uint64_t count);
+  void erase(vase::Shard *vase, uint64_t start, uint64_t count);
+};
+} // namespace bed::internal::syntax

include/internal/syntax/parser.h

@@ -1,42 +1,30 @@
 #pragma once
 
 #include "decl.h"
-#include "internal/vase/vase.h"
 #include "pch.h"
 
 namespace bed::internal::syntax {
-void dump_events(ParseState *node);
+struct ParserSnapshot {
+  ParseState *root = nullptr;
+  Language *lang = nullptr;
+};
 
-struct Parser {
-  static constexpr uint64_t MAX_CHUNK = 512;
+ParserSnapshot make_parser(vase::Shard *vase, uint64_t lines, Language *lang);
+ParserSnapshot retain(const ParserSnapshot &snap);
+void release(ParserSnapshot &snap);
 
-  ParseState *root;
-  Language lang;
-
-  Parser(vase::Shard *, uint64_t, Language);
-  ~Parser();
-  Parser(const Parser &) = delete;
-  Parser &operator=(const Parser &) = delete;
-
-  void reset(vase::Shard *, uint64_t, Language);
-  void erase(vase::Shard *, uint64_t, uint64_t);
-  void insert(vase::Shard *, uint64_t, uint64_t);
-  void modify(vase::Shard *, uint64_t, uint64_t);
-
-  uint64_t next_closing(uint64_t line);
-  uint64_t prev_opening(uint64_t line);
-
-  std::pair<ParseState *, ParseState *> split_tree(ParseState *node, uint64_t line);
-  ParseState *join_tree(ParseState *a, ParseState *b);
+void *state_before(const ParserSnapshot &snap, vase::Shard *vase, uint64_t line);
+uint64_t next_closing(const ParserSnapshot &snap, uint64_t line);
+uint64_t prev_opening(const ParserSnapshot &snap, uint64_t line);
 
 struct Iterator {
-    Parser *p;
+  ParserSnapshot snap;
   std::optional<vase::Iterator> it;
   void *state;
   uint64_t at;
-    std::vector<Token> tokens;
+  std::vector<io::Token> tokens;
   std::vector<ParseEvent> events;
-    Iterator(uint64_t, Parser *, vase::Shard *);
+  Iterator(uint64_t, ParserSnapshot, vase::Shard *);
   ~Iterator();
   Iterator(const Iterator &) = delete;
   Iterator &operator=(const Iterator &) = delete;
@@ -44,6 +32,24 @@ struct Parser {
   Iterator &operator=(Iterator &&other);
   void next();
 };
-  std::optional<Iterator> get_hl(vase::Shard *, uint64_t);
+
+std::optional<Iterator> get_hl(const ParserSnapshot &snap, vase::Shard *vase, uint64_t target);
+
+void insert(ParserSnapshot &snap, vase::Shard *vase, uint64_t start, uint64_t count);
+void erase(ParserSnapshot &snap, vase::Shard *vase, uint64_t start, uint64_t count);
+
+struct Edit {
+  ParserSnapshot *target;
+  bool dirty = false;
+  uint64_t dirty_start = 0;
+  uint64_t dirty_end = 0;
+  int64_t edit_delta = 0;
+
+  explicit Edit(ParserSnapshot &snap) : target(&snap) {}
+
+  void mark_dirty(uint64_t start, uint64_t end);
+  void insert(uint64_t start, uint64_t count);
+  void erase(uint64_t start, uint64_t count);
+  void commit(vase::Shard *vase);
 };
 } // namespace bed::internal::syntax

include/internal/syntax/ruby/decl.h

@@ -24,7 +24,8 @@ struct alignas(2) RubyState {
       DEF_NAME = 0b10,
       MODULE_NAME = 0b11
     };
-    static constexpr uint8_t NEWLINE = 1 << 5;
+    static constexpr uint8_t NEWLINE = 1 << 4;
+    static constexpr uint8_t ALLOW_ESCAPE = 1 << 5;
     static constexpr uint8_t ALLOW_INTERPOLATION = 1 << 6;
     static constexpr uint8_t EXPECTING_EXPRESSION = 1 << 7;
     uint8_t flags = 0;

include/internal/syntax/ruby/parser.h

@@ -104,6 +104,6 @@ struct RubyParser {
 
 void ruby_parse(
   void **v_state, std::string_view line, bool first_line,
-  std::vector<Token> *tokens, std::vector<ParseEvent> *events
+  std::vector<io::Token> *tokens, std::vector<ParseEvent> *events
 );
 } // namespace bed::internal::syntax::ruby

include/internal/syntax/ruby/tries.h

@@ -68,6 +68,11 @@ const static std::vector<std::string> builtins = {
 };
 
 const static std::vector<std::string> methods = {
+  // BEd methods.
+  "handle",
+  "register",
+  "unregister",
+  // Normal:
   "abort",
   "at_exit",
   "binding",

include/internal/theme/theme.h

@@ -6,11 +6,11 @@
 
 namespace bed::internal::theme {
 struct Theme {
-  std::array<Highlight, internal::syntax::Token::Count> hl;
+  std::array<io::Highlight, io::Token::Count> hl;
 
   Theme();
 
-  Highlight get(internal::syntax::Token token) const;
+  io::Highlight get(const io::Token::Kind &token) const;
 
   static Theme default_theme();
   static Theme from_name(std::string_view name);

include/internal/ui/command.h

@@ -0,0 +1,23 @@
+#pragma once
+
+#include "definitions.h"
+#include "pch.h"
+
+namespace bed::internal::ui {
+struct CommandIO {
+  std::string cmd;
+  uint16_t cursor;
+  std::string prompt;
+  uint16_t start;
+  uint16_t height;
+  uint16_t term_height;
+  uint16_t term_width;
+  BEd &bed;
+
+  CommandIO(BEd &);
+  std::pair<std::string, bool> run();
+  std::pair<std::string, bool> run_pipe();
+  std::pair<std::string, bool> run_terminal();
+  void redraw();
+};
+} // namespace bed::internal::ui

include/internal/ui/text_mode.h

@@ -0,0 +1,31 @@
+#pragma once
+
+#include "internal/syntax/miniparser.h"
+#include "pch.h"
+
+namespace bed::internal::ui::text_mode {
+struct TextMode {
+  struct Row {
+    uint64_t start;
+    uint64_t length;
+  };
+  using Lines = std::vector<Row>;
+  vase::Shard *vase;
+  vase::Point cursor;
+  std::optional<syntax::MiniParser> parser;
+  std::vector<Lines> lines;
+  uint16_t start;
+  uint16_t height;
+  uint16_t term_height;
+  uint16_t term_width;
+  BEd &bed;
+
+  TextMode(BEd &, vase::Shard *, syntax::Language *, void *);
+  std::pair<vase::Shard *, bool> run();
+  std::pair<vase::Shard *, bool> run_pipe();
+  std::pair<vase::Shard *, bool> run_terminal();
+  void grow();
+  void redraw();
+  void layout_lines();
+};
+} // namespace bed::internal::ui::text_mode

include/internal/vase/shard.h

@@ -12,29 +12,27 @@ struct Shard {
     Petal
   } kind;
 
-  uint8_t height;
+  uint16_t height;
   std::atomic_uint32_t refs;
 
   uint64_t length;
   uint64_t lines;
 
-  Shard(Kind kind, uint64_t length, uint64_t lines, uint8_t height)
+  Shard(Kind kind, uint64_t length, uint64_t lines, uint16_t height)
       : kind(kind), height(height), refs(1), length(length), lines(lines) {};
 
   static void retain(Shard *n);
   static void release(Shard *n);
 
-  static Shard *from_file(const std::filesystem::path &path, bool posix_ending);
-  static Shard *from_string(const char *data, uint64_t len, bool posix_ending);
-  static Shard *from_command(const char *cmd, bool posix_ending);
-  // static std::vector<Shard *> from_swap(std::filesystem::path &path, OriginalStorage *b);
+  static Shard *from_file(const std::filesystem::path &path);
+  static Shard *from_string(const char *data, uint64_t len);
+  static Shard *from_command(const char *cmd);
 
   static std::pair<Shard *, Shard *> split(Shard *n, uint64_t offset);
   static Shard *concat(Shard *a, Shard *b);
   static Shard *merge_leaves(Shard *a, Shard *b);
   static Shard *append(Shard *root, Shard *leaf);
   static Shard *build(Shard **pieces, uint64_t lo, uint64_t hi);
-  static void dump(Shard *node, int depth = 0);
 };
 
 struct Branch : Shard {
@@ -64,5 +62,4 @@ struct Petal : Shard {
     source->retain();
   };
 };
-
 } // namespace bed::internal::vase

include/internal/vase/vase.h

@@ -20,8 +20,8 @@ struct Range {
 };
 
 struct RegexGroup {
-  uint64_t start{0};
-  uint64_t end{0};
+  uint64_t start{UINT64_MAX};
+  uint64_t end{UINT64_MAX};
 };
 
 struct RegexMatch {
@@ -41,14 +41,18 @@ struct ReplacePart {
 
 uint64_t offset_of(Shard *root, uint64_t line);
 uint64_t offset_of(Shard *root, Point point);
-Point point_of(Shard *root, uint64_t offset);
+Point eof_point(Shard *root);
 
 std::string to_string(Shard *root);
 std::string to_string(Shard *root, Range range);
 
 Shard *insert(AppendStorage *ap, Shard *root, Shard *text, uint64_t line);
 Shard *erase(Shard *root, uint64_t start, uint64_t end);
+Shard *replace(Shard *root, Shard *text, uint64_t start, uint64_t end);
+Shard *join(Shard *root, uint64_t start, uint64_t end);
 Shard *copy(Shard *root, uint64_t start, uint64_t end);
+void write_file(std::filesystem::path path, Shard *text);
+void write_command(const char *cmd, Shard *text);
 
 uint64_t find_next(Shard *root, std::string_view pattern, uint64_t start);
 uint64_t find_prev(Shard *root, std::string_view pattern, uint64_t start);
@@ -56,7 +60,10 @@ uint64_t find_prev(Shard *root, std::string_view pattern, uint64_t start);
 Shard *substitute(
   AppendStorage *ap, Shard *root,
   std::string_view pattern, uint64_t start, uint64_t end,
-  std::string_view replace, std::string_view options
+  std::string_view replace, std::string_view options,
+  const std::function<void(
+    uint64_t line, uint64_t old_lines, uint64_t new_lines
+  )> &on_edit = nullptr
 );
 
 // internal

include/pch.h

@@ -4,10 +4,29 @@
 
 #include <mruby.h>
 #include <mruby/array.h>
+#include <mruby/boxing_word.h>
+#include <mruby/class.h>
+#include <mruby/common.h>
 #include <mruby/compile.h>
+#include <mruby/data.h>
+#include <mruby/dump.h>
+#include <mruby/error.h>
+#include <mruby/gc.h>
 #include <mruby/hash.h>
+#include <mruby/internal.h>
 #include <mruby/irep.h>
+#include <mruby/numeric.h>
+#include <mruby/object.h>
+#include <mruby/opcode.h>
+#include <mruby/presym.h>
+#include <mruby/proc.h>
+#include <mruby/range.h>
+#include <mruby/re.h>
 #include <mruby/string.h>
+#include <mruby/throw.h>
+#include <mruby/value.h>
+#include <mruby/variable.h>
+#include <mruby/version.h>
 #include <pcre2.h>
 extern "C" {
 #include <grapheme.h>
@@ -29,12 +48,12 @@ extern "C" {
 #include <filesystem>
 #include <fstream>
 #include <functional>
-#include <iostream>
 #include <limits.h>
 #include <map>
 #include <mutex>
 #include <optional>
 #include <poll.h>
+#include <pty.h>
 #include <queue>
 #include <set>
 #include <shared_mutex>

samples/bed.rb

@@ -0,0 +1,3 @@
+register :happy, address: :none do
+  puts "be nice"
+end

src/bed/bed.cc

@@ -0,0 +1,73 @@
+#include "bed.h"
+
+namespace bed {
+BEd::BEd(std::vector<std::string> args)
+    : mrb(this), theme(internal::theme::Theme::default_theme()), io(*this) {
+  std::string prompt_ = "";
+  std::string file = "";
+  bool suppress = false;
+  bool color = true;
+  for (size_t i = 1; i < args.size(); i++) {
+    if (args[i] == "-p") {
+      i++;
+      if (i >= args.size())
+        throw fatal_error("Prompt not specified!", 1);
+      prompt_ = args[i];
+    } else if (args[i] == "-s") {
+      suppress = true;
+    } else if (args[i] == "--no-color") {
+      color = false;
+    } else if (args[i] == "-v" || args[i] == "--verbose") {
+      help_mode = true;
+    } else if (args[i] == "-h" || args[i] == "--help") {
+      print_help();
+      throw fatal_error("", 0);
+    } else {
+      if (file.size())
+        throw fatal_error("Invalid arguments given.", 1);
+      file = args[i];
+    }
+  }
+  if (prompt_ != "")
+    prompt = [p = std::move(prompt_)](BEd &) { return p; };
+  else
+    prompt_mode = false;
+  suppress_mode = suppress;
+  const char *no_color = getenv("NO_COLOR");
+  if (no_color && *no_color != '\0')
+    color = false;
+  const char *colorterm = getenv("COLORTERM");
+  if (colorterm
+      && strcmp(colorterm, "truecolor") != 0
+      && strcmp(colorterm, "24bit") != 0)
+    color = false;
+  color_mode = color;
+  internal::functions::Function::register_posix(*this);
+  internal::functions::Function::register_extented(*this);
+  internal::functions::Suffix::register_suffixes(*this);
+  internal::scripting::register_basic(*this);
+  languages["ruby"] = new internal::syntax::Language(internal::syntax::ruby::lang_ruby());
+  buffers["clip"] = new internal::buffer::ClipBuffer("clip");
+  current() = {"default", 0};
+  try {
+    if (file != "")
+      handle(":default:E " + file, false);
+  } catch (ed_error &e) {
+    io.write_line("?");
+    if (help_mode)
+      io.write_line(e.what());
+    last_help = e.what();
+  }
+}
+
+BEd::~BEd() {
+  for (auto &[_, buffer] : buffers)
+    delete buffer;
+  for (auto &[_, lang] : languages)
+    delete lang;
+}
+
+void BEd::print_help() {
+  io.write("BEd - A line editor.\n");
+}
+} // namespace bed

src/bed/handle.cc

@@ -0,0 +1,115 @@
+#include "bed.h"
+#include "internal/parser/parser.h"
+
+namespace bed {
+void BEd::handle(std::string_view cmd, bool eof) {
+  if (eof && cmd.empty()) {
+    eof_op.handle(*this, "", nullptr, std::monostate(), nullptr);
+    return;
+  }
+  internal::parser::Command c = internal::parser::Parser::get_command(cmd, *this);
+  if (c.temp_address) {
+    marks.get(251) = marks.get(250);
+    prev_2 = prev_1;
+    temporary_current = true;
+  }
+  internal::buffer::Address address;
+  switch (c.function->address_kind) {
+  case internal::functions::Function::AddressKind::None: {
+    auto a = internal::parser::AddressPromise::get_line(*this, c.addresses);
+    if (!a.has_value()) {
+      auto vec = internal::parser::Parser::get_addresses(c.function->default_address, *this);
+      a = internal::parser::AddressPromise::get_line(*this, vec);
+      if (!a.has_value())
+        a = current();
+    }
+    address = a->buffername;
+  } break;
+  case internal::functions::Function::AddressKind::Line: {
+    auto a = internal::parser::AddressPromise::get_line(*this, c.addresses);
+    if (!a.has_value()) {
+      auto vec = internal::parser::Parser::get_addresses(c.function->default_address, *this);
+      a = internal::parser::AddressPromise::get_line(*this, vec);
+      if (!a.has_value())
+        a = current();
+    }
+    address = *a;
+  } break;
+  case internal::functions::Function::AddressKind::Range: {
+    auto a = internal::parser::AddressPromise::get_range(*this, c.addresses);
+    if (!a.has_value()) {
+      auto vec = internal::parser::Parser::get_addresses(c.function->default_address, *this);
+      a = internal::parser::AddressPromise::get_range(*this, vec);
+      if (!a.has_value())
+        a = internal::buffer::Range(current(), current());
+    }
+    address = *a;
+  } break;
+  }
+  if (std::holds_alternative<internal::buffer::Line>(c.argument)) {
+    if (c.argument_addresses.empty())
+      throw ed_error("Function needs address argument.");
+    auto a = internal::parser::AddressPromise::get_line(*this, c.argument_addresses);
+    if (a.has_value())
+      c.argument = *a;
+    else
+      c.argument = current();
+  } else if (std::holds_alternative<internal::buffer::Range>(c.argument)) {
+    if (c.argument_addresses.empty())
+      throw ed_error("Function needs address argument.");
+    auto a = internal::parser::AddressPromise::get_range(*this, c.argument_addresses);
+    if (a.has_value())
+      c.argument = *a;
+    else
+      c.argument = internal::buffer::Range(current(), current());
+  }
+  if (!c.function->accept_zero) {
+    if (std::holds_alternative<internal::buffer::Line>(address)) {
+      if (std::get<internal::buffer::Line>(address).number == 0)
+        throw ed_error("Line number can't be zero.");
+    } else if (std::holds_alternative<internal::buffer::Range>(address)) {
+      auto r = std::get<internal::buffer::Range>(address);
+      if (r.start == 0 || r.end == 0)
+        throw ed_error("Line number can't be zero.");
+    }
+  }
+  internal::vase::Shard *text = nullptr;
+  if (c.function->input_mode == internal::functions::Function::InputMode::Text) {
+    internal::vase::Shard *vase = nullptr;
+    internal::syntax::Language *lang = nullptr;
+    void *state = nullptr;
+    if (c.function->pre_text_mode)
+      std::tie(vase, lang, state) = c.function->pre_text_mode(*this, address, c.argument);
+    internal::ui::text_mode::TextMode tm(*this, vase, lang, state);
+    auto [a, b] = tm.run();
+    if (!b) {
+      text = a;
+    } else {
+      if (a) {
+        auto p = internal::syntax::make_parser(a, a->lines + 1, lang);
+        auto cancel_buf = new internal::buffer::ReadonlyBuffer("cancel", a, p);
+        internal::syntax::release(p);
+        buffers["cancel"] = cancel_buf;
+        cancel_buf->useless = false;
+        internal::vase::Shard::release(a);
+      }
+      throw ed_error("Operation cancelled.");
+    }
+  }
+  if (c.function->handle)
+    c.function->handle(*this, address, text, c.argument, nullptr);
+  if (c.suffix)
+    c.suffix->handle(*this);
+  if (c.temp_address)
+    temporary_current = false;
+  for (auto it = buffers.begin(); it != buffers.end();) {
+    internal::buffer::Buffer *buf = it->second;
+    if (buf->waste()) {
+      delete buf;
+      it = buffers.erase(it);
+    } else {
+      ++it;
+    }
+  }
+}
+} // namespace bed

src/bed/run.cc

@@ -2,133 +2,112 @@
 #include "internal/parser/parser.h"
 
 namespace bed {
-BEd::BEd(std::vector<std::string> args, internal::io::IO &io)
-    : theme(internal::theme::Theme::default_theme()), io(io) {
-  internal::functions::Function::register_posix(*this);
-  internal::functions::Suffix::register_suffixes(*this);
-  std::string prompt_ = "";
-  std::string file = "";
-  bool suppress = false;
-  for (size_t i = 1; i < args.size(); i++) {
-    if (args[i] == "-p") {
-      i++;
-      if (i >= args.size())
-        throw fatal_error("Prompt not specified!", 1);
-      prompt_ = args[i];
-    } else if (args[i] == "-s") {
-      suppress = true;
-    } else {
-      if (file.size())
-        throw fatal_error("Invalid arguments given.", 1);
-      file = args[i];
-    }
-  }
-  if (prompt_ != "")
-    prompt = [p = std::move(prompt_)](BEd &) { return p; };
-  else
-    prompt_mode = false;
-  suppress_mode = suppress;
-  try {
-    if (file != "")
-      handle(":default:E " + file, false);
-  } catch (ed_error &e) {
-    std::cout << "?" << std::endl;
-    if (help_mode)
-      std::cout << e.what() << std::endl;
-    last_help = e.what();
-  }
-}
-
-BEd::~BEd() {
-  for (auto &[_, buffer] : buffers)
-    delete buffer;
-}
-
 void BEd::run() {
   while (true) {
-    auto [cmd, eof] = io.get_command(*this);
+    internal::ui::CommandIO command(*this);
+    auto [cmd, eof] = command.run();
     try {
       handle(cmd, eof);
-    } catch (ed_error &e) {
-      std::cout << "?" << std::endl;
+    } catch (const ed_error &e) {
+      io.apply(internal::io::Token::Warning);
+      io.write_line("?");
       if (help_mode)
-        std::cout << e.what() << std::endl;
+        io.write_line(e.what());
+      io.reset();
       last_help = e.what();
     }
   }
 }
 
-void BEd::handle(std::string_view cmd, bool eof) {
-  if (eof) {
-    eof_op.handle(*this, "", nullptr, std::monostate(), nullptr);
-    return;
-  }
-  internal::parser::Command c = internal::parser::Parser::get_command(cmd, *this);
-  internal::buffer::Address address;
-  switch (c.function->address_kind) {
-  case internal::functions::Function::AddressKind::None: {
-    auto a = internal::parser::AddressPromise::get_line(*this, c.addresses);
-    if (a.has_value()) {
-      address = a->buffername;
-    } else {
-      auto vec = internal::parser::Parser::get_addresses(c.function->default_address, *this);
-      a = internal::parser::AddressPromise::get_line(*this, vec);
-      address = a->buffername;
-    }
-  } break;
-  case internal::functions::Function::AddressKind::Line: {
-    auto a = internal::parser::AddressPromise::get_line(*this, c.addresses);
-    if (a.has_value()) {
-      address = *a;
-    } else {
-      auto vec = internal::parser::Parser::get_addresses(c.function->default_address, *this);
-      a = internal::parser::AddressPromise::get_line(*this, vec);
-      address = *a;
-    }
-  } break;
-  case internal::functions::Function::AddressKind::Range: {
-    auto a = internal::parser::AddressPromise::get_range(*this, c.addresses);
-    if (a.has_value()) {
-      address = *a;
-    } else {
-      auto vec = internal::parser::Parser::get_addresses(c.function->default_address, *this);
-      a = internal::parser::AddressPromise::get_range(*this, vec);
-      address = *a;
-    }
-  } break;
-  }
-  if (std::holds_alternative<internal::buffer::Line>(c.argument)) {
-    auto a = internal::parser::AddressPromise::get_line(*this, c.argument_addresses);
-    if (a.has_value())
-      c.argument = *a;
-    else
-      c.argument = current();
-  } else if (std::holds_alternative<internal::buffer::Range>(c.argument)) {
-    auto a = internal::parser::AddressPromise::get_range(*this, c.argument_addresses);
-    if (a.has_value())
-      c.argument = *a;
-    else
-      c.argument = internal::buffer::Range(current(), current());
-  }
-  c.function->handle(*this, address, nullptr, c.argument, nullptr);
-  if (c.suffix)
-    c.suffix->handle(*this);
-}
-
 internal::buffer::Buffer &BEd::buffer(const std::string &name) {
+  if (name.empty())
+    throw ed_error("Can't have empty buffer name");
+  {
     auto it = buffers.find(name);
     if (it != buffers.end())
       return *it->second;
-  auto *buf = new internal::buffer::Buffer(name);
+  }
+  constexpr std::string_view prefix = "history/";
+  if (name == "cancel")
+    throw ed_error("Cancel buffer empty.");
+  if (name.starts_with(prefix)) {
+    std::string_view path{name};
+    path.remove_prefix(prefix.size());
+    auto slash = path.rfind('_');
+    if (slash == std::string_view::npos || slash == 0 || slash == path.size() - 1)
+      throw ed_error("invalid history");
+    std::string bufname(path.substr(0, slash));
+    auto version_str = path.substr(slash + 1);
+    std::size_t version;
+    try {
+      version = std::stoull(std::string(version_str));
+    } catch (...) {
+      throw ed_error("invalid history version");
+    }
+    auto it = buffers.find(bufname);
+    if (it != buffers.end()) {
+      auto &buf_ = *it->second;
+      if (buf_.kind != internal::buffer::Buffer::Kind::Generic)
+        throw ed_error("Only normal buffers can have history.");
+      auto &buf = *(internal::buffer::GenericBuffer *)&buf_;
+      auto *history_buf = buf.get_history(version);
+      buffers.emplace(name, history_buf);
+      return *history_buf;
+    }
+    throw ed_error("Buffer has no history.");
+  }
+  for (auto &c : name)
+    if (!(('0' <= c && c <= '9')
+          || ('a' <= c && c <= 'z')
+          || ('A' <= c && c <= 'Z')
+          || c == '-' || c == '_'
+          || c == '+' || c == '.'
+          || c == ',' || c == '$'
+          || c == '/' || c == '~'))
+      throw ed_error("Invalid buffer name.");
+  auto *buf = new internal::buffer::GenericBuffer(name);
   buffers.emplace(name, buf);
   return *buf;
 }
 
 internal::buffer::Line &BEd::current() {
-  return marks.get(250);
+  return marks.get(250 + temporary_current);
 }
 
-void BEd::mark(char m, internal::buffer::Line line) {
+internal::buffer::Range &BEd::prev() {
+  if (temporary_current)
+    return prev_2;
+  else
+    return prev_1;
+}
+
+void BEd::mark(uint8_t m, internal::buffer::Line line) {
   marks.get(m) = line;
 }
+
+bool BEd::escape_command(std::string &cmd, std::string_view filename) {
+  bool modified = false;
+  if (cmd == "!") {
+    cmd = last_shell;
+    modified = true;
+  }
+  last_shell = cmd;
+  for (size_t i = 0; i < cmd.size();) {
+    if (cmd[i] == '\\') {
+      if (i + 1 >= cmd.size())
+        break;
+      cmd.erase(i++, 1);
+      continue;
+    }
+    if (cmd[i] == '%') {
+      cmd.erase(i, 1);
+      cmd.insert(i, filename);
+      i += filename.size();
+      modified = true;
+      continue;
+    }
+    i++;
+  }
+  return modified;
+}
 } // namespace bed

src/internal/buffer/buffer.cc

@@ -1,250 +0,0 @@
-#include "internal/buffer/buffer.h"
-#include "bed.h"
-
-namespace bed::internal::buffer {
-Buffer::Buffer(std::string name)
-    : state(Unmodified), root(nullptr), name(name) {
-  parser.emplace(root, lines(), syntax::ruby::lang_ruby()); // just for debug.
-}
-
-Buffer::~Buffer() {
-  vase::Shard::release(root);
-}
-
-uint64_t Buffer::lines() {
-  if (root)
-    return root->lines + 1;
-  return 0;
-}
-
-void Buffer::append(BEd &ctx, vase::Shard *text, uint64_t line) {
-  ctx.prev.buffername = name;
-  ctx.prev.start = line;
-  ctx.prev.end = line + text->lines;
-  root = vase::insert(&ctx.append, root, text, line);
-  ctx.marks.insert(name, ctx.prev.start, ctx.prev.end);
-  if (parser)
-    parser->insert(root, ctx.prev.start, ctx.prev.end);
-  state = Modified;
-}
-
-void Buffer::remove(BEd &ctx, uint64_t start_line, uint64_t end_line) {
-  root = vase::erase(root, start_line, end_line);
-  ctx.prev.buffername = name;
-  ctx.prev.start = start_line;
-  ctx.prev.end = start_line;
-  ctx.marks.erase(name, start_line, end_line - start_line + 1);
-  if (parser)
-    parser->erase(root, start_line, end_line - start_line + 1);
-  state = Modified;
-}
-
-void Buffer::join(BEd &ctx, uint64_t start_line, uint64_t end_line) {
-  root = vase::substitute(&ctx.append, root, R"(\n)", start_line, end_line, "", "g");
-  ctx.prev.buffername = name;
-  ctx.prev.start = start_line;
-  ctx.prev.end = start_line;
-  ctx.marks.collapse(name, start_line, end_line - start_line);
-  if (parser)
-    parser->erase(root, start_line, end_line - start_line);
-  state = Modified;
-}
-
-void Buffer::substitute(
-  BEd &ctx, uint64_t start_line, uint64_t end_line,
-  std::string &regex, std::string &replacement, std::string &options
-) {
-  // make substitue return a list of modifications made.
-  root = vase::substitute(&ctx.append, root, regex, start_line, end_line, replacement, options);
-  /*prev_range.start = start_line;
-  prev_range.end = start_line;
-  marks.collapse(start_line, end_line - start_line);
-  if (parser)
-    parser->erase(vase, start_line, end_line - start_line);*/
-  state = Modified;
-}
-
-vase::Shard *Buffer::copy(uint64_t start_line, uint64_t end_line) {
-  return vase::copy(root, start_line, end_line);
-}
-
-inline void apply(std::ostream &out, const Highlight &hl) {
-  out << "\x1b[0m";
-  const uint8_t r = (hl.fg >> 16) & 0xff;
-  const uint8_t g = (hl.fg >> 8) & 0xff;
-  const uint8_t b = hl.fg & 0xff;
-  out << "\x1b[38;2;"
-      << (unsigned)r << ';'
-      << (unsigned)g << ';'
-      << (unsigned)b << 'm';
-  if (hl.bg != 0) {
-    const uint8_t br = (hl.bg >> 16) & 0xff;
-    const uint8_t bg = (hl.bg >> 8) & 0xff;
-    const uint8_t bb = hl.bg & 0xff;
-    out << "\x1b[48;2;"
-        << (unsigned)br << ';'
-        << (unsigned)bg << ';'
-        << (unsigned)bb << 'm';
-  }
-  if (hl.flags & Highlight::Bold)
-    out << "\x1b[1m";
-  if (hl.flags & Highlight::Italic)
-    out << "\x1b[3m";
-  if (hl.flags & Highlight::Underline)
-    out << "\x1b[4m";
-  if (hl.flags & Highlight::Strikethrough)
-    out << "\x1b[9m";
-}
-
-inline void reset(std::ostream &out) {
-  out << "\x1b[0m";
-}
-
-void Buffer::print(BEd &ctx, uint64_t start_line, uint64_t end_line) {
-  ctx.prev.buffername = name;
-  ctx.prev.start = start_line;
-  ctx.prev.end = end_line;
-  if (parser) {
-    std::optional<syntax::Parser::Iterator> it_o = parser->get_hl(root, start_line - 1);
-    auto &it = *it_o;
-    while (start_line <= end_line) {
-      it.next();
-      const std::string &line = it.it->line;
-      const auto &tokens = it.tokens;
-      uint32_t cursor = 0;
-      for (const auto &token : tokens) {
-        const uint32_t start = token.start;
-        const uint32_t end = token.end;
-        if (start > line.size())
-          break;
-        if (end > line.size())
-          break;
-        if (cursor < start) {
-          std::cout.write(
-            line.data() + cursor,
-            start - cursor
-          );
-        }
-        const auto highlight = ctx.theme.get(token);
-        apply(std::cout, highlight);
-        std::cout.write(line.data() + start, end - start);
-        reset(std::cout);
-        cursor = end;
-      }
-      if (cursor < line.size())
-        std::cout.write(line.data() + cursor, line.size() - cursor);
-      std::cout << std::endl;
-      ++start_line;
-    }
-  } else {
-    vase::Iterator it(root, start_line - 1, Direction::Forward);
-    while (it.next() && start_line++ <= end_line)
-      std::cout << it.line << std::endl;
-  }
-}
-
-void Buffer::number_print(BEd &ctx, uint64_t start_line, uint64_t end_line) {
-  ctx.prev.buffername = name;
-  ctx.prev.start = start_line;
-  ctx.prev.end = end_line;
-  uint8_t width = 1;
-  for (uint64_t n = end_line; n >= 10; n /= 10)
-    ++width;
-  if (parser) {
-    std::optional<syntax::Parser::Iterator> it_o = parser->get_hl(root, start_line - 1);
-    auto &it = *it_o;
-    while (start_line <= end_line) {
-      it.next();
-      std::cout << std::setw(width) << start_line << "\t";
-      const std::string &line = it.it->line;
-      const auto &tokens = it.tokens;
-      uint32_t cursor = 0;
-      for (const auto &token : tokens) {
-        const uint32_t start = token.start;
-        const uint32_t end = token.end;
-        if (start > line.size())
-          break;
-        if (end > line.size())
-          break;
-        if (cursor < start) {
-          std::cout.write(
-            line.data() + cursor,
-            start - cursor
-          );
-        }
-        const auto highlight = ctx.theme.get(token);
-        apply(std::cout, highlight);
-        std::cout.write(line.data() + start, end - start);
-        reset(std::cout);
-        cursor = end;
-      }
-      if (cursor < line.size())
-        std::cout.write(line.data() + cursor, line.size() - cursor);
-      std::cout << std::endl;
-      ++start_line;
-    }
-  } else {
-    vase::Iterator it(root, start_line - 1, Direction::Forward);
-    while (it.next() && start_line <= end_line)
-      std::cout << std::setw(width) << start_line++ << "\t" << it.line << std::endl;
-  }
-}
-
-std::string Buffer::list_string(std::string_view s) {
-  uint32_t width = 80;
-  winsize ws{};
-  if (ioctl(STDOUT_FILENO, TIOCGWINSZ, &ws) == 0 && ws.ws_col != 0)
-    width = ws.ws_col;
-  std::string out;
-  out.reserve(s.size());
-  const uint32_t max_width = width > 1 ? width - 1 : 1;
-  uint32_t column = 0;
-  auto append = [&](std::string_view text) {
-    if (column + text.size() > max_width) {
-      out += "\\\n";
-      column = 0;
-    }
-    out += text;
-    column += text.size();
-  };
-  for (unsigned char c : s) {
-    switch (c) {
-    case '\\':
-      append("\\\\");
-      break;
-    case '$':
-      append("\\$");
-      break;
-    case '\a':
-      append("\\a");
-      break;
-    case '\b':
-      append("\\b");
-      break;
-    case '\f':
-      append("\\f");
-      break;
-    case '\r':
-      append("\\r");
-      break;
-    case '\t':
-      append("\\t");
-      break;
-    case '\v':
-      append("\\v");
-      break;
-    default:
-      if (!std::isprint(c)) {
-        char buf[5];
-        std::snprintf(buf, sizeof(buf), "\\%03o", c);
-        append(buf);
-      } else {
-        append(std::string_view((const char *)&c, 1));
-      }
-      break;
-    }
-  }
-  out += '$';
-  return out;
-}
-} // namespace bed::internal::buffer

src/internal/buffer/generic.cc

@@ -0,0 +1,370 @@
+#include "bed.h"
+#include "internal/buffer/buffer.h"
+
+namespace bed::internal::buffer {
+GenericBuffer::~GenericBuffer() {
+  for (auto &item : undo_stack) {
+    syntax::release(item.parse_state);
+    vase::Shard::release(item.text);
+  }
+  for (auto &item : redo_stack) {
+    syntax::release(item.parse_state);
+    vase::Shard::release(item.text);
+  }
+}
+
+void GenericBuffer::list_history(BEd &ctx) {
+  uint64_t current = base_version + undo_stack.size();
+  uint64_t max_version = current + redo_stack.size();
+  size_t width = std::to_string(max_version).size();
+  for (size_t i = 0; i < undo_stack.size(); ++i) {
+    auto &item = undo_stack[i];
+    uint64_t version = base_version + i;
+    auto time = std::chrono::system_clock::to_time_t(item.timestamp);
+    std::tm tm = *std::localtime(&time);
+    ctx.io.write_line(
+      std::format(
+        "  {:>{}}  {:04}-{:02}-{:02} {:02}:{:02}:{:02} {}",
+        version,
+        width,
+        tm.tm_year + 1900,
+        tm.tm_mon + 1,
+        tm.tm_mday,
+        tm.tm_hour,
+        tm.tm_min,
+        tm.tm_sec,
+        item.summary
+      )
+    );
+  }
+  {
+    auto time = std::chrono::system_clock::to_time_t(timestamp);
+    std::tm tm = *std::localtime(&time);
+    ctx.io.write_line(
+      std::format(
+        "* {:>{}}  {:04}-{:02}-{:02} {:02}:{:02}:{:02} {}",
+        current,
+        width,
+        tm.tm_year + 1900,
+        tm.tm_mon + 1,
+        tm.tm_mday,
+        tm.tm_hour,
+        tm.tm_min,
+        tm.tm_sec,
+        action
+      )
+    );
+  }
+  for (size_t i = 0; i < redo_stack.size(); ++i) {
+    auto &item = redo_stack[redo_stack.size() - 1 - i];
+    uint64_t version = current + i + 1;
+    auto time = std::chrono::system_clock::to_time_t(item.timestamp);
+    std::tm tm = *std::localtime(&time);
+    ctx.io.write_line(
+      std::format(
+        "  {:>{}}  {:04}-{:02}-{:02} {:02}:{:02}:{:02} {}",
+        version,
+        width,
+        tm.tm_year + 1900,
+        tm.tm_mon + 1,
+        tm.tm_mday,
+        tm.tm_hour,
+        tm.tm_min,
+        tm.tm_sec,
+        item.summary
+      )
+    );
+  }
+}
+
+ReadonlyBuffer *GenericBuffer::get_history(uint64_t version) {
+  uint64_t current = base_version + undo_stack.size();
+  if (version < base_version)
+    throw ed_error("History version has been pruned.");
+  if (version < current) {
+    auto &item = undo_stack[version - base_version];
+    return new ReadonlyBuffer(name, item.text, item.parse_state);
+  }
+  if (version == current)
+    return new ReadonlyBuffer(name, root, parse);
+  uint64_t redo_offset = version - current - 1;
+  if (redo_offset >= redo_stack.size())
+    throw ed_error("No such history version.");
+  auto &item = redo_stack[redo_stack.size() - 1 - redo_offset];
+  return new ReadonlyBuffer(name, item.text, item.parse_state);
+}
+
+void GenericBuffer::snapshot(std::string action_) {
+  if (base_version == 0) {
+    base_version++;
+  } else {
+    vase::Shard::retain(root);
+    undo_stack.push_back(
+      HistoryItem{
+        syntax::retain(parse),
+        root,
+        timestamp,
+        action
+      }
+    );
+  }
+  for (auto &item : redo_stack) {
+    syntax::release(item.parse_state);
+    vase::Shard::release(item.text);
+  }
+  redo_stack.clear();
+  timestamp = std::chrono::system_clock::now();
+  action = action_;
+}
+
+bool GenericBuffer::undo(BEd &ctx) {
+  if (undo_stack.empty())
+    return false;
+  HistoryItem prev = undo_stack.back();
+  undo_stack.pop_back();
+  vase::Shard::retain(root);
+  redo_stack.push_back(
+    HistoryItem{
+      syntax::retain(parse),
+      root,
+      timestamp,
+      action
+    }
+  );
+  vase::Shard::release(root);
+  root = prev.text;
+  syntax::release(parse);
+  parse = prev.parse_state;
+  timestamp = prev.timestamp;
+  action = prev.summary;
+  state = Modified;
+  if (!root) {
+    ctx.prev().buffername = name;
+    ctx.prev().start = 0;
+    ctx.prev().end = 0;
+  } else {
+    ctx.prev().buffername = name;
+    ctx.prev().start = 1;
+    ctx.prev().end = root->lines + 1;
+  }
+  return true;
+}
+
+bool GenericBuffer::redo(BEd &ctx) {
+  if (redo_stack.empty())
+    return false;
+  HistoryItem next = redo_stack.back();
+  redo_stack.pop_back();
+  vase::Shard::retain(root);
+  undo_stack.push_back(
+    HistoryItem{
+      syntax::retain(parse),
+      root,
+      timestamp,
+      action
+    }
+  );
+  vase::Shard::release(root);
+  root = next.text;
+  syntax::release(parse);
+  parse = next.parse_state;
+  timestamp = next.timestamp;
+  action = next.summary;
+  state = Modified;
+  if (!root) {
+    ctx.prev().buffername = name;
+    ctx.prev().start = 0;
+    ctx.prev().end = 0;
+  } else {
+    ctx.prev().buffername = name;
+    ctx.prev().start = 1;
+    ctx.prev().end = root->lines + 1;
+  }
+  return true;
+}
+
+uint64_t GenericBuffer::prune(int keep) {
+  size_t drop =
+    undo_stack.size() > (size_t)keep
+      ? undo_stack.size() - keep
+      : 0;
+  for (size_t i = 0; i < drop; ++i) {
+    syntax::release(undo_stack[i].parse_state);
+    vase::Shard::release(undo_stack[i].text);
+  }
+  undo_stack.erase(
+    undo_stack.begin(),
+    undo_stack.begin() + drop
+  );
+  base_version += drop;
+  for (auto &item : redo_stack) {
+    syntax::release(item.parse_state);
+    vase::Shard::release(item.text);
+  }
+  redo_stack.clear();
+  return undo_stack.size();
+}
+
+bool GenericBuffer::waste() {
+  return save_path.empty()
+         && root == nullptr
+         && undo_stack.empty()
+         && parse.lang == nullptr;
+}
+
+void GenericBuffer::saved_hook() {
+  state = buffer::GenericBuffer::Unmodified;
+}
+
+void GenericBuffer::language(BEd &ctx, std::string name) {
+  syntax::Language *lang = nullptr;
+  if (name.size()) {
+    auto it = ctx.languages.find(name);
+    if (it == ctx.languages.end())
+      throw ed_error("Language not found.");
+    lang = it->second;
+  }
+  if (lang == parse.lang)
+    return;
+  snapshot("Change buffer language.");
+  syntax::release(parse);
+  parse = syntax::make_parser(root, lines(), lang);
+}
+
+void GenericBuffer::load(BEd &ctx, vase::Shard *text) {
+  snapshot("Load file.");
+  if (lines())
+    ctx.marks.erase(name, 1, lines());
+  vase::Shard::release(root);
+  vase::Shard::retain(text);
+  root = text;
+  state = buffer::GenericBuffer::Unmodified;
+  if (!text) {
+    ctx.prev().buffername = name;
+    ctx.prev().start = 0;
+    ctx.prev().end = 0;
+  } else {
+    ctx.prev().buffername = name;
+    ctx.prev().start = 1;
+    ctx.prev().end = text->lines + 1;
+  }
+  ctx.current() = {name, lines()};
+  syntax::release(parse);
+  parse = syntax::make_parser(root, lines(), nullptr);
+}
+
+void GenericBuffer::set_filename(std::filesystem::path path) {
+  save_path = path;
+}
+
+std::filesystem::path GenericBuffer::filename() {
+  return save_path;
+};
+
+void GenericBuffer::append(BEd &ctx, vase::Shard *text, uint64_t line) {
+  snapshot(std::format("Insert {} lines after line {}", (text ? text->lines + 1 : 1), line));
+  ctx.prev().buffername = name;
+  ctx.prev().start = line + 1;
+  ctx.prev().end = line + (text ? text->lines + 1 : 1);
+  ctx.current() = {name, line + (text ? text->lines + 1 : 1)};
+  root = vase::insert(&ctx.append, root, text, line);
+  ctx.marks.insert(name, line, (text ? text->lines + 1 : 1));
+  if (parse.lang)
+    syntax::insert(parse, root, line, (text ? text->lines + 1 : 1));
+  state = Modified;
+}
+
+void GenericBuffer::remove(BEd &ctx, uint64_t start_line, uint64_t end_line) {
+  snapshot(std::format("Remove lines {} to {}", start_line, end_line));
+  root = vase::erase(root, start_line, end_line);
+  ctx.prev().buffername = name;
+  uint64_t l = std::min(start_line, lines());
+  ctx.prev().start = l;
+  ctx.prev().end = l;
+  ctx.current() = {name, l};
+  ctx.marks.erase(name, start_line, end_line - start_line + 1);
+  if (parse.lang)
+    syntax::erase(parse, root, start_line, end_line - start_line + 1);
+  state = Modified;
+}
+
+void GenericBuffer::replace(BEd &ctx, vase::Shard *text, uint64_t start_line, uint64_t end_line) {
+  if (!text) {
+    remove(ctx, start_line, end_line);
+    return;
+  }
+  snapshot(std::format("Replace lines {} to {} with {} lines", start_line, end_line, text->lines));
+  ctx.prev().buffername = name;
+  ctx.prev().start = start_line;
+  ctx.prev().end = start_line + text->lines;
+  ctx.current() = {name, start_line + text->lines};
+  uint64_t new_count = text->lines + 1;
+  uint64_t old_count = end_line - start_line + 1;
+  root = vase::replace(root, text, start_line, end_line);
+  if (parse.lang) {
+    syntax::Edit edit(parse);
+    edit.erase(start_line, old_count);
+    edit.insert(start_line, new_count);
+    edit.commit(root);
+  }
+  if (new_count > old_count) {
+    uint64_t diff = new_count - old_count;
+    ctx.marks.insert(name, end_line, diff);
+  } else if (new_count < old_count) {
+    uint64_t diff = old_count - new_count;
+    ctx.marks.collapse(name, start_line + new_count - 1, diff);
+  }
+  state = Modified;
+}
+
+void GenericBuffer::join(BEd &ctx, uint64_t start_line, uint64_t end_line) {
+  snapshot(std::format("Join lines {} to {}", start_line, end_line));
+  root = vase::join(root, start_line, end_line);
+  ctx.prev().buffername = name;
+  ctx.prev().start = start_line;
+  ctx.prev().end = start_line;
+  ctx.current() = {name, start_line};
+  ctx.marks.collapse(name, start_line, end_line - start_line);
+  if (parse.lang)
+    syntax::erase(parse, root, start_line, end_line - start_line);
+  state = Modified;
+}
+
+void GenericBuffer::substitute(
+  BEd &ctx, uint64_t start_line, uint64_t end_line,
+  std::string &regex, std::string &replacement, std::string &options
+) {
+  snapshot(std::format("Substitute /{}/ with /{}/ in lines {} to {}", regex, replacement, start_line, end_line));
+  ctx.prev().buffername = name;
+  ctx.prev().start = start_line;
+  ctx.prev().end = end_line;
+  std::optional<syntax::Edit> edit;
+  if (parse.lang)
+    edit.emplace(parse);
+  root = vase::substitute(
+    &ctx.append,
+    root,
+    regex,
+    start_line,
+    end_line,
+    replacement,
+    options,
+    [&](uint64_t line, uint64_t old_lines, uint64_t new_lines) {
+      if (old_lines) {
+        ctx.marks.erase(name, line, old_lines);
+        if (edit)
+          edit->erase(line, old_lines);
+      }
+      if (new_lines) {
+        ctx.marks.insert(name, line, new_lines);
+        if (edit)
+          edit->insert(line, new_lines);
+      }
+      ctx.current() = {name, line + new_lines};
+    }
+  );
+  if (edit)
+    edit->commit(root);
+  state = Modified;
+}
+} // namespace bed::internal::buffer

src/internal/buffer/shard.cc

@@ -0,0 +1,141 @@
+#include "bed.h"
+#include "internal/buffer/buffer.h"
+
+namespace bed::internal::buffer {
+uint64_t ShardBuffer::lines() {
+  if (root)
+    return root->lines + 1;
+  return 0;
+}
+
+uint64_t ShardBuffer::bytes() {
+  if (root)
+    return root->length + 1;
+  return 0;
+}
+
+vase::Shard *ShardBuffer::copy(uint64_t start_line, uint64_t end_line) {
+  return vase::copy(root, start_line, end_line);
+}
+
+uint64_t ShardBuffer::find_next(std::string_view pattern, uint64_t start) {
+  return vase::find_next(root, pattern, start);
+}
+
+uint64_t ShardBuffer::find_prev(std::string_view pattern, uint64_t start) {
+  return vase::find_prev(root, pattern, start);
+}
+
+uint64_t ShardBuffer::next_closing(uint64_t start) {
+  if (parse.lang) {
+    uint64_t closing = syntax::next_closing(parse, start - 1);
+    return closing + 1;
+  } else {
+    start += 10;
+    if (start > lines())
+      return lines();
+    return start;
+  }
+}
+
+uint64_t ShardBuffer::prev_closing(uint64_t start) {
+  if (parse.lang) {
+    return syntax::prev_opening(parse, start - 1) + 1;
+  } else {
+    if (start > 10)
+      return start - 10;
+    return 0;
+  }
+}
+
+void ShardBuffer::print(BEd &ctx, uint64_t start_line, uint64_t end_line) {
+  ctx.prev().buffername = name;
+  ctx.prev().start = start_line;
+  ctx.prev().end = end_line;
+  if (parse.lang) {
+    auto it_o = syntax::get_hl(parse, root, start_line - 1);
+    if (!it_o)
+      goto h;
+    auto &it = *it_o;
+    while (start_line <= end_line) {
+      it.next();
+      const std::string &line = it.it->line;
+      const auto &tokens = it.tokens;
+      uint32_t cursor = 0;
+      for (const auto &token : tokens) {
+        const uint32_t start = token.start;
+        const uint32_t end = token.end;
+        if (start > line.size() || end > line.size())
+          break;
+        if (cursor < start)
+          ctx.io.write(line.data() + cursor, start - cursor);
+        ctx.io.apply(token.type);
+        ctx.io.write(line.data() + start, end - start);
+        ctx.io.reset();
+        cursor = end;
+      }
+      if (cursor < line.size())
+        ctx.io.write(line.data() + cursor, line.size() - cursor);
+      ctx.io.write_line("");
+      ++start_line;
+    }
+  } else {
+  h:
+    vase::Iterator it(root, start_line - 1, Direction::Forward);
+    while (it.next() && start_line++ <= end_line)
+      ctx.io.write_line(it.line);
+  }
+}
+
+void ShardBuffer::number_print(BEd &ctx, uint64_t start_line, uint64_t end_line) {
+  ctx.prev().buffername = name;
+  ctx.prev().start = start_line;
+  ctx.prev().end = end_line;
+  uint8_t width = 1;
+  for (uint64_t n = end_line; n >= 10; n /= 10)
+    ++width;
+  if (parse.lang) {
+    std::optional<syntax::Iterator> it_o = syntax::get_hl(parse, root, start_line - 1);
+    if (!it_o)
+      goto h;
+    auto &it = *it_o;
+    while (start_line <= end_line) {
+      it.next();
+      ctx.io.write(std::format("{:>{}}\t", start_line, width));
+      const std::string &line = it.it->line;
+      const auto &tokens = it.tokens;
+      uint32_t cursor = 0;
+      for (const auto &token : tokens) {
+        const uint32_t start = token.start;
+        const uint32_t end = token.end;
+        if (start > line.size() || end > line.size())
+          break;
+        if (cursor < start)
+          ctx.io.write(line.data() + cursor, start - cursor);
+        ctx.io.apply(token.type);
+        ctx.io.write(line.data() + start, end - start);
+        ctx.io.reset();
+        cursor = end;
+      }
+      if (cursor < line.size())
+        ctx.io.write(line.data() + cursor, line.size() - cursor);
+      ctx.io.write_line("");
+      ++start_line;
+    }
+  } else {
+  h:
+    vase::Iterator it(root, start_line - 1, Direction::Forward);
+    while (it.next() && start_line <= end_line)
+      ctx.io.write_line(std::format("{:>{}}\t{}", start_line++, width, it.line));
+  }
+}
+
+void ShardBuffer::list_print(BEd &ctx, uint64_t start_line, uint64_t end_line) {
+  ctx.prev().buffername = name;
+  ctx.prev().start = start_line;
+  ctx.prev().end = end_line;
+  vase::Iterator it(root, start_line - 1, Direction::Forward);
+  while (it.next() && start_line++ <= end_line)
+    ctx.io.write_line(list_string(it.line));
+}
+} // namespace bed::internal::buffer

src/internal/buffer/special/clip.cc

@@ -0,0 +1,210 @@
+#include "bed.h"
+#include "internal/buffer/buffer.h"
+
+namespace bed::internal::buffer {
+ClipBuffer::~ClipBuffer() {}
+
+bool ClipBuffer::waste() {
+  return false;
+}
+
+void ClipBuffer::saved_hook() {}
+
+uint64_t ClipBuffer::lines() {
+  auto s = vase::Shard::from_command("xclip -selection clipboard -o");
+  uint64_t lines = s ? s->lines + 1 : 0;
+  vase::Shard::release(s);
+  return lines;
+}
+
+uint64_t ClipBuffer::bytes() {
+  auto s = vase::Shard::from_command("xclip -selection clipboard -o");
+  uint64_t length = s ? s->length + 1 : 0;
+  vase::Shard::release(s);
+  return length;
+}
+
+void ClipBuffer::clip_write(vase::Shard *text) {
+  FILE *pipe = popen("xclip -selection clipboard -i", "w");
+  if (!pipe)
+    throw ed_error("can't access clipboard");
+  auto s = vase::to_string(text);
+  fwrite(s.data(), 1, s.length(), pipe);
+  if (pclose(pipe) != 0)
+    throw ed_error("can't write clipboard");
+}
+
+void ClipBuffer::load(BEd &ctx, vase::Shard *text) {
+  clip_write(text);
+  if (!text) {
+    ctx.prev().buffername = name;
+    ctx.prev().start = 0;
+    ctx.prev().end = 0;
+  } else {
+    ctx.prev().buffername = name;
+    ctx.prev().start = 1;
+    ctx.prev().end = text->lines + 1;
+  }
+}
+
+void ClipBuffer::set_filename(std::filesystem::path) {}
+
+std::filesystem::path ClipBuffer::filename() {
+  return "";
+};
+
+void ClipBuffer::append(BEd &ctx, vase::Shard *text, uint64_t line) {
+  ctx.prev().buffername = name;
+  ctx.prev().start = line + 1;
+  ctx.prev().end = line + (text ? text->lines + 1 : 0);
+  auto s = vase::Shard::from_command("xclip -selection clipboard -o");
+  s = vase::insert(&ctx.append, s, text, line);
+  clip_write(s);
+  vase::Shard::release(s);
+  ctx.marks.insert(name, line, text->lines + 1);
+}
+
+void ClipBuffer::remove(BEd &ctx, uint64_t start_line, uint64_t end_line) {
+  auto s = vase::Shard::from_command("xclip -selection clipboard -o");
+  s = vase::erase(s, start_line, end_line);
+  clip_write(s);
+  ctx.prev().buffername = name;
+  ctx.prev().start = std::min(start_line, s ? s->lines + 1 : 0);
+  ctx.prev().end = std::min(start_line, s ? s->lines + 1 : 0);
+  vase::Shard::release(s);
+  ctx.marks.erase(name, start_line, end_line - start_line + 1);
+}
+
+void ClipBuffer::replace(BEd &ctx, vase::Shard *text, uint64_t start_line, uint64_t end_line) {
+  if (!text) {
+    remove(ctx, start_line, end_line);
+    return;
+  }
+  ctx.prev().buffername = name;
+  ctx.prev().start = start_line;
+  ctx.prev().end = start_line + text->lines;
+  uint64_t new_count = text->lines + 1;
+  uint64_t old_count = end_line - start_line + 1;
+  auto s = vase::Shard::from_command("xclip -selection clipboard -o");
+  s = vase::replace(s, text, start_line, end_line);
+  clip_write(s);
+  vase::Shard::release(s);
+  if (new_count > old_count) {
+    uint64_t diff = new_count - old_count;
+    ctx.marks.insert(name, end_line, diff);
+  } else if (new_count < old_count) {
+    uint64_t diff = old_count - new_count;
+    ctx.marks.collapse(name, start_line + new_count - 1, diff);
+  }
+}
+
+void ClipBuffer::join(BEd &ctx, uint64_t start_line, uint64_t end_line) {
+  auto s = vase::Shard::from_command("xclip -selection clipboard -o");
+  s = vase::join(s, start_line, end_line);
+  clip_write(s);
+  vase::Shard::release(s);
+  ctx.prev().buffername = name;
+  ctx.prev().start = start_line;
+  ctx.prev().end = start_line;
+  ctx.marks.collapse(name, start_line, end_line - start_line);
+}
+
+void ClipBuffer::substitute(
+  BEd &ctx, uint64_t start_line, uint64_t end_line,
+  std::string &regex, std::string &replacement, std::string &options
+) {
+  ctx.prev().buffername = name;
+  ctx.prev().start = start_line;
+  ctx.prev().end = end_line;
+  auto s = vase::Shard::from_command("xclip -selection clipboard -o");
+  s = vase::substitute(
+    &ctx.append,
+    s,
+    regex,
+    start_line,
+    end_line,
+    replacement,
+    options,
+    [&](uint64_t line, uint64_t old_lines, uint64_t new_lines) {
+      if (old_lines)
+        ctx.marks.erase(name, line, old_lines);
+      if (new_lines)
+        ctx.marks.insert(name, line, new_lines);
+    }
+  );
+  clip_write(s);
+  vase::Shard::release(s);
+  ctx.prev().buffername = name;
+}
+
+vase::Shard *ClipBuffer::copy(uint64_t start_line, uint64_t end_line) {
+  auto s = vase::Shard::from_command("xclip -selection clipboard -o");
+  vase::Shard *o = vase::copy(s, start_line, end_line);
+  vase::Shard::release(s);
+  return o;
+}
+
+uint64_t ClipBuffer::find_next(std::string_view pattern, uint64_t start) {
+  auto s = vase::Shard::from_command("xclip -selection clipboard -o");
+  uint64_t line = vase::find_next(s, pattern, start);
+  vase::Shard::release(s);
+  return line;
+}
+
+uint64_t ClipBuffer::find_prev(std::string_view pattern, uint64_t start) {
+  auto s = vase::Shard::from_command("xclip -selection clipboard -o");
+  uint64_t line = vase::find_prev(s, pattern, start);
+  vase::Shard::release(s);
+  return line;
+}
+
+uint64_t ClipBuffer::next_closing(uint64_t start) {
+  start += 10;
+  uint64_t line = lines();
+  if (start > line)
+    return line;
+  return start;
+}
+
+uint64_t ClipBuffer::prev_closing(uint64_t start) {
+  if (start > 10)
+    return start - 10;
+  return 0;
+}
+
+void ClipBuffer::print(BEd &ctx, uint64_t start_line, uint64_t end_line) {
+  ctx.prev().buffername = name;
+  ctx.prev().start = start_line;
+  ctx.prev().end = end_line;
+  auto s = vase::Shard::from_command("xclip -selection clipboard -o");
+  vase::Iterator it(s, start_line - 1, Direction::Forward);
+  while (it.next() && start_line++ <= end_line)
+    ctx.io.write_line(it.line);
+  vase::Shard::release(s);
+}
+
+void ClipBuffer::number_print(BEd &ctx, uint64_t start_line, uint64_t end_line) {
+  ctx.prev().buffername = name;
+  ctx.prev().start = start_line;
+  ctx.prev().end = end_line;
+  uint8_t width = 1;
+  for (uint64_t n = end_line; n >= 10; n /= 10)
+    ++width;
+  auto s = vase::Shard::from_command("xclip -selection clipboard -o");
+  vase::Iterator it(s, start_line - 1, Direction::Forward);
+  while (it.next() && start_line <= end_line)
+    ctx.io.write_line(std::format("{:>{}}\t{}", start_line++, width, it.line));
+  vase::Shard::release(s);
+}
+
+void ClipBuffer::list_print(BEd &ctx, uint64_t start_line, uint64_t end_line) {
+  ctx.prev().buffername = name;
+  ctx.prev().start = start_line;
+  ctx.prev().end = end_line;
+  auto s = vase::Shard::from_command("xclip -selection clipboard -o");
+  vase::Iterator it(s, start_line - 1, Direction::Forward);
+  while (it.next() && start_line++ <= end_line)
+    ctx.io.write_line(list_string(it.line));
+  vase::Shard::release(s);
+}
+} // namespace bed::internal::buffer

src/internal/functions/extended.cc

@@ -0,0 +1,531 @@
+#include "bed.h"
+#include "internal/functions/functions.h"
+#include "internal/functions/suffixes.h"
+
+namespace bed::internal::functions {
+static std::string_view address_kind_str(Function::AddressKind k) {
+  switch (k) {
+  case Function::AddressKind::None:
+    return "none";
+  case Function::AddressKind::Line:
+    return "1 line";
+  case Function::AddressKind::Range:
+    return "range";
+  }
+  return "";
+}
+
+static std::string_view input_mode_str(Function::InputMode m) {
+  switch (m) {
+  case Function::InputMode::None:
+    return "";
+  case Function::InputMode::Text:
+    return "text";
+  case Function::InputMode::Interactive:
+    return "interactive";
+  case Function::InputMode::CommandList:
+    return "command list";
+  }
+  return "";
+}
+
+static std::string_view argument_kind_str(Function::ArgumentKind a) {
+  switch (a) {
+  case Function::ArgumentKind::None:
+    return "";
+  case Function::ArgumentKind::Regex:
+    return "regex";
+  case Function::ArgumentKind::Shell:
+    return "shell command";
+  case Function::ArgumentKind::Any:
+    return "any";
+  case Function::ArgumentKind::File:
+    return "file";
+  case Function::ArgumentKind::Global:
+    return "ed global-style";
+  case Function::ArgumentKind::Mark:
+    return "mark name";
+  case Function::ArgumentKind::Number:
+    return "number";
+  case Function::ArgumentKind::Line:
+    return "address";
+  case Function::ArgumentKind::Range:
+    return "range";
+  case Function::ArgumentKind::Ruby:
+    return "ruby code";
+  }
+  return "";
+}
+
+static void append_field(BEd &ctx, std::string_view label, io::Token::Kind color, std::string_view value) {
+  if (value.empty())
+    return;
+  ctx.io.write("\n");
+  ctx.io.apply(color);
+  ctx.io.write(label);
+  ctx.io.reset();
+  ctx.io.write(": ");
+  ctx.io.write(value);
+}
+
+static void describe_function(BEd &ctx, const Function &func) {
+  ctx.io.write(func.desc);
+  ctx.io.reset();
+  append_field(ctx, "Default address", io::Token::Color1, func.default_address);
+  append_field(ctx, "Address", io::Token::Color2, address_kind_str(func.address_kind));
+  if (func.accept_zero)
+    append_field(ctx, "Zero address", io::Token::Color3, "allowed");
+  append_field(ctx, "Input", io::Token::Color4, input_mode_str(func.input_mode));
+  append_field(ctx, "Argument", io::Token::Color5, argument_kind_str(func.argument_kind));
+  ctx.io.write("\n");
+}
+
+void Function::register_extented(BEd &ctx) {
+  ctx.functions.insert(
+    "*",
+    Function{
+      .address_kind = Function::AddressKind::None,
+      .argument_kind = Function::ArgumentKind::Any,
+      .input_mode = Function::InputMode::None,
+      .desc = "Explain a command",
+      .default_address = "",
+      .accept_zero = false,
+      .pre_text_mode = nullptr,
+      .handle = [](
+                  BEd &ctx,
+                  const buffer::Address &,
+                  vase::Shard *,
+                  const Argument &arg_,
+                  std::vector<buffer::Line> *
+                ) {
+        auto str = std::get<std::string>(arg_);
+        const auto first = str.find_first_not_of(" \t");
+        const auto last = str.find_last_not_of(" \t");
+        if (first == std::string::npos)
+          str.clear();
+        else
+          str = str.substr(first, last - first + 1);
+        if (str.empty()) {
+          describe_function(ctx, ctx.no_op);
+          return;
+        }
+        auto len = ctx.functions.longest_match(str);
+        if (len == str.size()) {
+          describe_function(ctx, *ctx.functions.get_ptr(str));
+          return;
+        }
+        throw ed_error("Not a valid function name.");
+      },
+    }
+  );
+  ctx.functions.insert(
+    "b",
+    Function{
+      .address_kind = Function::AddressKind::None,
+      .argument_kind = Function::ArgumentKind::None,
+      .input_mode = Function::InputMode::None,
+      .desc = "List active buffers",
+      .default_address = "",
+      .accept_zero = false,
+      .pre_text_mode = nullptr,
+      .handle = [](
+                  BEd &ctx,
+                  const buffer::Address &addr_,
+                  vase::Shard *,
+                  const Argument &,
+                  std::vector<buffer::Line> *
+                ) {
+        auto &current = std::get<std::string>(addr_);
+        bool current_real = false;
+        for (auto &[name, _] : ctx.buffers) {
+          if (current == name) {
+            ctx.io.write("* ");
+            current_real = true;
+          } else {
+            ctx.io.write("  ");
+          }
+          ctx.io.write_line(name);
+        }
+        if (!current_real)
+          ctx.io.write_line("* " + current);
+      },
+    }
+  );
+  ctx.functions.insert(
+    "#",
+    Function{
+      .address_kind = Function::AddressKind::None,
+      .argument_kind = Function::ArgumentKind::Any,
+      .input_mode = Function::InputMode::None,
+      .desc = "Write a comment",
+      .default_address = "",
+      .accept_zero = false,
+      .pre_text_mode = nullptr,
+      .handle = [](
+                  BEd &,
+                  const buffer::Address &,
+                  vase::Shard *,
+                  const Argument &,
+                  std::vector<buffer::Line> *
+                ) {},
+    }
+  );
+  ctx.functions.insert(
+    "`",
+    Function{
+      .address_kind = Function::AddressKind::Range,
+      .argument_kind = Function::ArgumentKind::Ruby,
+      .input_mode = Function::InputMode::None,
+      .desc = "Execute given ruby code.",
+      .default_address = "0,0",
+      .accept_zero = true,
+      .pre_text_mode = nullptr,
+      .handle = [](
+                  BEd &ctx,
+                  const buffer::Address &addr_,
+                  vase::Shard *,
+                  const Argument &arg_,
+                  std::vector<buffer::Line> *
+                ) {
+        auto &addr = std::get<buffer::Range>(addr_);
+        auto &arg = std::get<RubyArg>(arg_);
+        auto pre_code = "$START=" + std::to_string(addr.start)
+                        + ";$END=" + std::to_string(addr.end)
+                        + ";$BUFNAME=\"" + addr.buffername + "\"";
+        scripting::run(ctx, pre_code);
+        auto line = scripting::run(ctx, arg.cmd);
+        ctx.io.write("=> ", 3);
+        auto parser = syntax::MiniParser(
+          *ctx.languages["ruby"],
+          vase::Shard::from_string(line.data(), line.size()),
+          nullptr
+        );
+        const auto &tokens = parser.lines[0].second;
+        uint32_t cursor = 0;
+        for (const auto &token : tokens) {
+          const uint32_t start = token.start;
+          const uint32_t end = token.end;
+          if (start > line.size() || end > line.size())
+            break;
+          if (cursor < start)
+            ctx.io.write(line.data() + cursor, start - cursor);
+          ctx.io.apply(token.type);
+          ctx.io.write(line.data() + start, end - start);
+          ctx.io.reset();
+          cursor = end;
+        }
+        if (cursor < line.size())
+          ctx.io.write(line.data() + cursor, line.size() - cursor);
+        ctx.io.write_line("");
+      },
+    }
+  );
+  ctx.functions.insert(
+    "``",
+    Function{
+      .address_kind = Function::AddressKind::Range,
+      .argument_kind = Function::ArgumentKind::None,
+      .input_mode = Function::InputMode::None,
+      .desc = "Execute addressed lines as ruby code.",
+      .default_address = "1,$",
+      .accept_zero = false,
+      .pre_text_mode = nullptr,
+      .handle = [](
+                  BEd &ctx,
+                  const buffer::Address &addr_,
+                  vase::Shard *,
+                  const Argument &,
+                  std::vector<buffer::Line> *
+                ) {
+        auto &addr = std::get<buffer::Range>(addr_);
+        auto &buf = ctx.buffer(addr.buffername);
+        auto code = buf.copy(addr.start, addr.end);
+        ctx.prev().buffername = addr.buffername;
+        ctx.prev().start = addr.start;
+        ctx.prev().end = addr.end;
+        ctx.current() = {addr.buffername, addr.end};
+        auto pre_code = "$START=" + std::to_string(addr.start)
+                        + ";$END=" + std::to_string(addr.end)
+                        + ";$BUFNAME=\"" + addr.buffername + "\"";
+        scripting::run(ctx, pre_code);
+        scripting::run(ctx, vase::to_string(code));
+        vase::Shard::release(code);
+      },
+    }
+  );
+  ctx.functions.insert(
+    "echo",
+    Function{
+      .address_kind = Function::AddressKind::Range,
+      .argument_kind = Function::ArgumentKind::Any,
+      .input_mode = Function::InputMode::None,
+      .desc = "Echo the given message (replacing $1-$4 with address information)",
+      .default_address = "",
+      .accept_zero = true,
+      .pre_text_mode = nullptr,
+      .handle = [](
+                  BEd &ctx,
+                  const buffer::Address &addr_,
+                  vase::Shard *,
+                  const Argument &arg_,
+                  std::vector<buffer::Line> *
+                ) {
+        auto &addr = std::get<buffer::Range>(addr_);
+        auto str = std::get<std::string>(arg_);
+        const auto first = str.find_first_not_of(" \t");
+        const auto last = str.find_last_not_of(" \t");
+        if (first == std::string::npos)
+          str.clear();
+        else
+          str = str.substr(first, last - first + 1);
+        for (size_t i = 0; i < str.size();) {
+          if (str[i] == '\\') {
+            if (i + 1 >= str.size())
+              break;
+            str.erase(i++, 1);
+            if (str[i - 1] == 'n')
+              str[i - 1] = '\n';
+            continue;
+          }
+          if (str[i] == '$' && i + 1 < str.size() && '1' <= str[i + 1] && str[i + 1] <= '4') {
+            char c = str[i + 1];
+            str.erase(i, 2);
+            switch (c) {
+            case '1': {
+              auto start = std::to_string(addr.start);
+              str.insert(i, start);
+              i += start.size();
+            } break;
+            case '2': {
+              auto end = std::to_string(addr.end);
+              str.insert(i, end);
+              i += end.size();
+            } break;
+            case '3': {
+              str.insert(i, addr.buffername);
+              i += addr.buffername.size();
+            } break;
+            case '4': {
+              auto &buf = ctx.buffer(addr.buffername);
+              auto filename = buf.filename().string();
+              str.insert(i, filename);
+              i += filename.size();
+            } break;
+            }
+            continue;
+          }
+          i++;
+        }
+        ctx.io.write_line(str);
+      },
+    }
+  );
+  ctx.functions.insert(
+    "cd",
+    Function{
+      .address_kind = Function::AddressKind::None,
+      .argument_kind = Function::ArgumentKind::Any,
+      .input_mode = Function::InputMode::None,
+      .desc = "Change directory",
+      .default_address = "",
+      .accept_zero = false,
+      .pre_text_mode = nullptr,
+      .handle = [](
+                  BEd &,
+                  const buffer::Address &,
+                  vase::Shard *,
+                  const Argument &arg_,
+                  std::vector<buffer::Line> *
+                ) {
+        auto path = std::get<std::string>(arg_);
+        const auto first = path.find_first_not_of(" \t");
+        const auto last = path.find_last_not_of(" \t");
+        if (first == std::string::npos)
+          path.clear();
+        else
+          path = path.substr(first, last - first + 1);
+        if (path.empty())
+          path = getenv("HOME");
+        if (path == "~")
+          path = getenv("HOME");
+        if (path.starts_with("~/")) {
+          const char *home = getenv("HOME");
+          if (home)
+            path = std::string(home) + path.substr(1);
+        }
+        if (chdir(path.c_str()) == -1)
+          throw ed_error("Can't change directory.");
+      },
+    }
+  );
+  ctx.functions.insert(
+    "pwd",
+    Function{
+      .address_kind = Function::AddressKind::None,
+      .argument_kind = Function::ArgumentKind::None,
+      .input_mode = Function::InputMode::None,
+      .desc = "Print the current working directory",
+      .default_address = "",
+      .accept_zero = false,
+      .pre_text_mode = nullptr,
+      .handle = [](
+                  BEd &ctx,
+                  const buffer::Address &,
+                  vase::Shard *,
+                  const Argument &,
+                  std::vector<buffer::Line> *
+                ) {
+        char cwd[PATH_MAX];
+        if (!getcwd(cwd, sizeof(cwd)))
+          throw ed_error("Can't determine current directory.");
+        ctx.io.write_line(cwd);
+      },
+    }
+  );
+  ctx.functions.insert(
+    "x",
+    Function{
+      .address_kind = Function::AddressKind::Range,
+      .argument_kind = Function::ArgumentKind::Range,
+      .input_mode = Function::InputMode::None,
+      .desc = "Exchange a range of lines for another",
+      .default_address = ".,.",
+      .accept_zero = false,
+      .pre_text_mode = nullptr,
+      .handle = [](
+                  BEd &ctx,
+                  const buffer::Address &addr_,
+                  vase::Shard *,
+                  const Argument &arg_,
+                  std::vector<buffer::Line> *
+                ) {
+        auto addr = std::get<buffer::Range>(addr_);
+        auto arg = std::get<buffer::Range>(arg_);
+        auto text = ctx.buffer(addr.buffername).copy(addr.start, addr.end);
+        try {
+          ctx.buffer(arg.buffername).replace(ctx, text, arg.start, arg.end);
+          vase::Shard::release(text);
+        } catch (...) {
+          vase::Shard::release(text);
+          throw;
+        }
+      },
+    }
+  );
+  ctx.functions.insert(
+    "U",
+    Function{
+      .address_kind = Function::AddressKind::None,
+      .argument_kind = Function::ArgumentKind::None,
+      .input_mode = Function::InputMode::None,
+      .desc = "Redo the last undo modification",
+      .default_address = "",
+      .accept_zero = false,
+      .pre_text_mode = nullptr,
+      .handle = [](
+                  BEd &ctx,
+                  const buffer::Address &addr_,
+                  vase::Shard *,
+                  const Argument &,
+                  std::vector<buffer::Line> *
+                ) {
+        auto &addr = std::get<std::string>(addr_);
+        auto &buf_ = ctx.buffer(addr);
+        if (buf_.kind != buffer::Buffer::Kind::Generic)
+          throw ed_error("Can't redo buffer");
+        auto &buf = *(buffer::GenericBuffer *)&buf_;
+        if (!buf.redo(ctx))
+          throw ed_error("Can't redo buffer.");
+      }
+    }
+  );
+  ctx.functions.insert(
+    "hl",
+    Function{
+      .address_kind = Function::AddressKind::None,
+      .argument_kind = Function::ArgumentKind::None,
+      .input_mode = Function::InputMode::None,
+      .desc = "List available history versions",
+      .default_address = "",
+      .accept_zero = false,
+      .pre_text_mode = nullptr,
+      .handle = [](
+                  BEd &ctx,
+                  const buffer::Address &addr_,
+                  vase::Shard *,
+                  const Argument &,
+                  std::vector<buffer::Line> *
+                ) {
+        auto &addr = std::get<std::string>(addr_);
+        auto &buf_ = ctx.buffer(addr);
+        if (buf_.kind != buffer::Buffer::Kind::Generic)
+          throw ed_error("Can't redo buffer");
+        auto &buf = *(buffer::GenericBuffer *)&buf_;
+        buf.list_history(ctx);
+      }
+    }
+  );
+  ctx.functions.insert(
+    "hp",
+    Function{
+      .address_kind = Function::AddressKind::None,
+      .argument_kind = Function::ArgumentKind::Number,
+      .input_mode = Function::InputMode::None,
+      .desc = "Prune old history versions",
+      .default_address = "",
+      .accept_zero = false,
+      .pre_text_mode = nullptr,
+      .handle = [](
+                  BEd &ctx,
+                  const buffer::Address &addr_,
+                  vase::Shard *,
+                  const Argument &arg_,
+                  std::vector<buffer::Line> *
+                ) {
+        auto &addr = std::get<std::string>(addr_);
+        auto &arg = std::get<int64_t>(arg_);
+        auto &buf_ = ctx.buffer(addr);
+        if (buf_.kind != buffer::Buffer::Kind::Generic)
+          throw ed_error("Can't prune buffer.");
+        auto &buf = *(buffer::GenericBuffer *)&buf_;
+        auto versions = buf.prune(arg);
+        if (!ctx.suppress_mode)
+          ctx.io.write_line(std::format("{} undo versions left.", versions));
+      }
+    }
+  );
+  ctx.functions.insert(
+    "lang",
+    Function{
+      .address_kind = Function::AddressKind::None,
+      .argument_kind = Function::ArgumentKind::Any,
+      .input_mode = Function::InputMode::None,
+      .desc = "Set buffer language",
+      .default_address = "",
+      .accept_zero = false,
+      .pre_text_mode = nullptr,
+      .handle = [](
+                  BEd &ctx,
+                  const buffer::Address &addr_,
+                  vase::Shard *,
+                  const Argument &arg_,
+                  std::vector<buffer::Line> *
+                ) {
+        auto &addr = std::get<std::string>(addr_);
+        auto name = std::get<std::string>(arg_);
+        const auto first = name.find_first_not_of(" \t");
+        const auto last = name.find_last_not_of(" \t");
+        if (first == std::string::npos)
+          name.clear();
+        else
+          name = name.substr(first, last - first + 1);
+        auto &buf_ = ctx.buffer(addr);
+        if (buf_.kind != buffer::Buffer::Kind::Generic)
+          throw ed_error("Can't set language to buffer.");
+        auto &buf = *(buffer::GenericBuffer *)&buf_;
+        buf.language(ctx, name);
+      }
+    }
+  );
+}
+} // namespace bed::internal::functions

src/internal/functions/functions.cc

@@ -1,295 +0,0 @@
-#include "internal/functions/functions.h"
-#include "bed.h"
-#include "internal/functions/suffixes.h"
-
-namespace bed::internal::functions {
-void Suffix::register_suffixes(BEd &ctx) {
-  ctx.suffixes['p' - 'a'] = Suffix{
-    .desc = "Prints current line.",
-    .handle = [](BEd &ctx) {
-      auto &addr = ctx.current();
-      ctx.buffer(addr.buffername).print(ctx, addr.number, addr.number);
-    }
-  };
-  ctx.suffixes['n' - 'a'] = Suffix{
-    .desc = "Prints current line with line number.",
-    .handle = [](BEd &ctx) {
-      auto &addr = ctx.current();
-      ctx.buffer(addr.buffername).number_print(ctx, addr.number, addr.number);
-    }
-  };
-}
-
-void Function::register_posix(BEd &ctx) {
-  ctx.no_op = Function{
-    .address_kind = Function::AddressKind::Line,
-    .argument_kind = Function::ArgumentKind::None,
-    .input_mode = Function::InputMode::None,
-    .desc = "Prints a line and jumps to it.",
-    .default_address = ".+1",
-    .accept_zero = false,
-    .pre_text_mode = nullptr,
-    .handle = [](BEd &ctx, const buffer::Address &addr_, vase::Shard *, const Argument &, std::vector<buffer::Line> *) {
-      auto addr = std::get<buffer::Line>(addr_);
-      ctx.buffer(addr.buffername).print(ctx, addr.number, addr.number);
-      ctx.current() = addr;
-    }
-  };
-  ctx.eof_op = Function{
-    .address_kind = Function::AddressKind::None,
-    .argument_kind = Function::ArgumentKind::None,
-    .input_mode = Function::InputMode::None,
-    .desc = "Try quitting.",
-    .default_address = "",
-    .accept_zero = false,
-    .pre_text_mode = nullptr,
-    .handle = [](BEd &ctx, const buffer::Address &, vase::Shard *, const Argument &, std::vector<buffer::Line> *) {
-      for (auto &[name, buffer] : ctx.buffers) {
-        if (buffer->state == buffer::Buffer::Modified) {
-          buffer->state = buffer::Buffer::Warned;
-          throw ed_error("Buffer " + name + " modified.");
-        }
-      }
-      throw fatal_error("Quitting", 0);
-    }
-  };
-  ctx.functions.insert(
-    "j",
-    Function{
-      .address_kind = Function::AddressKind::Range,
-      .argument_kind = Function::ArgumentKind::None,
-      .input_mode = Function::InputMode::None,
-      .desc = "Join a set of lines.",
-      .default_address = ".,.+1",
-      .accept_zero = false,
-      .pre_text_mode = nullptr,
-      .handle = [](BEd &ctx, const buffer::Address &addr_, vase::Shard *, const Argument &, std::vector<buffer::Line> *) {
-        auto addr = std::get<buffer::Range>(addr_);
-        ctx.buffer(addr.buffername).join(ctx, addr.start, addr.end);
-        ctx.current() = {addr.buffername, addr.start};
-      }
-    }
-  );
-  ctx.functions.insert(
-    "q",
-    Function{
-      .address_kind = Function::AddressKind::None,
-      .argument_kind = Function::ArgumentKind::None,
-      .input_mode = Function::InputMode::None,
-      .desc = "Try quitting.",
-      .default_address = "",
-      .accept_zero = false,
-      .pre_text_mode = nullptr,
-      .handle = [](BEd &ctx, const buffer::Address &, vase::Shard *, const Argument &, std::vector<buffer::Line> *) {
-        for (auto &[name, buffer] : ctx.buffers) {
-          if (buffer->state == buffer::Buffer::Modified) {
-            buffer->state = buffer::Buffer::Warned;
-            throw ed_error("Buffer " + name + " modified.");
-          }
-        }
-        throw fatal_error("Quitting", 0);
-      }
-    }
-  );
-  ctx.functions.insert(
-    "Q",
-    Function{
-      .address_kind = Function::AddressKind::None,
-      .argument_kind = Function::ArgumentKind::None,
-      .input_mode = Function::InputMode::None,
-      .desc = "Force quit.",
-      .default_address = "",
-      .accept_zero = false,
-      .pre_text_mode = nullptr,
-      .handle = [](BEd &, const buffer::Address &, vase::Shard *, const Argument &, std::vector<buffer::Line> *) {
-        throw fatal_error("Force Quitting", 0);
-      }
-    }
-  );
-  ctx.functions.insert(
-    "p",
-    Function{
-      .address_kind = Function::AddressKind::Range,
-      .argument_kind = Function::ArgumentKind::None,
-      .input_mode = Function::InputMode::None,
-      .desc = "Print range",
-      .default_address = ".,.",
-      .accept_zero = false,
-      .pre_text_mode = nullptr,
-      .handle = [](BEd &ctx, const buffer::Address &addr_, vase::Shard *, const Argument &, std::vector<buffer::Line> *) {
-        auto addr = std::get<buffer::Range>(addr_);
-        ctx.buffer(addr.buffername).print(ctx, addr.start, addr.end);
-        ctx.current() = {addr.buffername, addr.end};
-      },
-    }
-  );
-  ctx.functions.insert(
-    "n",
-    Function{
-      .address_kind = Function::AddressKind::Range,
-      .argument_kind = Function::ArgumentKind::None,
-      .input_mode = Function::InputMode::None,
-      .desc = "Print range with line numbers",
-      .default_address = ".,.",
-      .accept_zero = false,
-      .pre_text_mode = nullptr,
-      .handle = [](BEd &ctx, const buffer::Address &addr_, vase::Shard *, const Argument &, std::vector<buffer::Line> *) {
-        auto addr = std::get<buffer::Range>(addr_);
-        ctx.buffer(addr.buffername).number_print(ctx, addr.start, addr.end);
-        ctx.current() = {addr.buffername, addr.end};
-      },
-    }
-  );
-  ctx.functions.insert(
-    "=",
-    Function{
-      .address_kind = Function::AddressKind::Range,
-      .argument_kind = Function::ArgumentKind::None,
-      .input_mode = Function::InputMode::None,
-      .desc = "Print line numbers",
-      .default_address = "$",
-      .accept_zero = true,
-      .pre_text_mode = nullptr,
-      .handle = [](BEd &, const buffer::Address &addr_, vase::Shard *, const Argument &, std::vector<buffer::Line> *) {
-        auto addr = std::get<buffer::Range>(addr_);
-        if (addr.start == addr.end)
-          std::cout << ':' << addr.buffername << ':' << addr.start << "\n";
-        else
-          std::cout << ':' << addr.buffername << ':' << addr.start << "," << addr.end << "\n";
-      },
-    }
-  );
-  ctx.functions.insert(
-    "k",
-    Function{
-      .address_kind = Function::AddressKind::Line,
-      .argument_kind = Function::ArgumentKind::Mark,
-      .input_mode = Function::InputMode::None,
-      .desc = "Mark a line.",
-      .default_address = ".",
-      .accept_zero = false,
-      .pre_text_mode = nullptr,
-      .handle = [](BEd &ctx, const buffer::Address &addr_, vase::Shard *, const Argument &arg, std::vector<buffer::Line> *) {
-        auto addr = std::get<buffer::Line>(addr_);
-        ctx.mark(std::get<char>(arg), addr);
-      }
-    }
-  );
-  ctx.functions.insert(
-    "e",
-    Function{
-      .address_kind = Function::AddressKind::None,
-      .argument_kind = Function::ArgumentKind::File,
-      .input_mode = Function::InputMode::None,
-      .desc = "Try load a file into the current buffer.",
-      .default_address = "",
-      .accept_zero = false,
-      .pre_text_mode = nullptr,
-      .handle = [](BEd &ctx, const buffer::Address &addr_, vase::Shard *, const Argument &arg, std::vector<buffer::Line> *) {
-        auto &addr = std::get<std::string>(addr_);
-        auto &buf = ctx.buffer(addr);
-        if (buf.state == buffer::Buffer::Modified) {
-          buf.state = buffer::Buffer::Warned;
-          throw ed_error("Buffer modified.");
-        }
-        vase::Shard *s = nullptr;
-        if (std::holds_alternative<std::filesystem::path>(arg)) {
-          s = vase::Shard::from_file(std::get<std::filesystem::path>(arg), true);
-          buf.save_path = std::get<std::filesystem::path>(arg);
-        } else if (std::holds_alternative<ShellArg>(arg)) {
-          s = vase::Shard::from_command(std::get<ShellArg>(arg).cmd.c_str(), true);
-        } else if (std::holds_alternative<std::monostate>(arg)) {
-          if (buf.save_path != "")
-            s = vase::Shard::from_file(buf.save_path, true);
-          else
-            throw ed_error("Need filename to load.");
-        }
-        try {
-          if (buf.lines())
-            buf.remove(ctx, 1, buf.lines());
-          buf.append(ctx, s, 0);
-          buf.state = buffer::Buffer::Unmodified;
-        } catch (...) {
-          vase::Shard::release(s);
-          throw;
-        }
-        std::cout << (s->length + 1) << std::endl;
-        vase::Shard::release(s);
-        ctx.current() = {addr, buf.lines()};
-      }
-    }
-  );
-  ctx.functions.insert(
-    "E",
-    Function{
-      .address_kind = Function::AddressKind::None,
-      .argument_kind = Function::ArgumentKind::File,
-      .input_mode = Function::InputMode::None,
-      .desc = "Load a file into the current buffer.",
-      .default_address = "",
-      .accept_zero = false,
-      .pre_text_mode = nullptr,
-      .handle = [](BEd &ctx, const buffer::Address &addr_, vase::Shard *, const Argument &arg, std::vector<buffer::Line> *) {
-        auto &addr = std::get<std::string>(addr_);
-        auto &buf = ctx.buffer(addr);
-        vase::Shard *s = nullptr;
-        if (std::holds_alternative<std::filesystem::path>(arg)) {
-          s = vase::Shard::from_file(std::get<std::filesystem::path>(arg), true);
-          buf.save_path = std::get<std::filesystem::path>(arg);
-        } else if (std::holds_alternative<ShellArg>(arg)) {
-          s = vase::Shard::from_command(std::get<ShellArg>(arg).cmd.c_str(), true);
-        } else if (std::holds_alternative<std::monostate>(arg)) {
-          if (buf.save_path != "")
-            s = vase::Shard::from_file(buf.save_path, true);
-          else
-            throw ed_error("Need filename to load.");
-        }
-        try {
-          if (buf.lines())
-            buf.remove(ctx, 1, buf.lines());
-          buf.append(ctx, s, 0);
-          buf.state = buffer::Buffer::Unmodified;
-        } catch (...) {
-          vase::Shard::release(s);
-          throw;
-        }
-        std::cout << (s->length + 1) << std::endl;
-        vase::Shard::release(s);
-        ctx.current() = {addr, buf.lines()};
-      }
-    }
-  );
-  ctx.functions.insert(
-    "H",
-    Function{
-      .address_kind = Function::AddressKind::None,
-      .argument_kind = Function::ArgumentKind::None,
-      .input_mode = Function::InputMode::None,
-      .desc = "Toggle help mode.",
-      .default_address = "",
-      .accept_zero = false,
-      .pre_text_mode = nullptr,
-      .handle = [](BEd &ctx, const buffer::Address &, vase::Shard *, const Argument &, std::vector<buffer::Line> *) {
-        ctx.help_mode = !ctx.help_mode;
-        if (ctx.help_mode)
-          std::cout << ctx.last_help << std::endl;
-      }
-    }
-  );
-  ctx.functions.insert(
-    "h",
-    Function{
-      .address_kind = Function::AddressKind::None,
-      .argument_kind = Function::ArgumentKind::None,
-      .input_mode = Function::InputMode::None,
-      .desc = "Print last help message",
-      .default_address = "",
-      .accept_zero = false,
-      .pre_text_mode = nullptr,
-      .handle = [](BEd &ctx, const buffer::Address &, vase::Shard *, const Argument &, std::vector<buffer::Line> *) {
-        std::cout << ctx.last_help << std::endl;
-      }
-    }
-  );
-}
-} // namespace bed::internal::functions

src/internal/functions/posix.cc

@@ -0,0 +1,885 @@
+#include "bed.h"
+#include "internal/functions/functions.h"
+#include "internal/functions/suffixes.h"
+
+namespace bed::internal::functions {
+void Suffix::register_suffixes(BEd &ctx) {
+  ctx.suffixes['p' - 'a'] = Suffix{
+    .desc = "Prints current line.",
+    .handle = [](BEd &ctx) {
+      auto &addr = ctx.current();
+      ctx.buffer(addr.buffername).print(ctx, addr.number, addr.number);
+    }
+  };
+  ctx.suffixes['n' - 'a'] = Suffix{
+    .desc = "Prints current line with line number.",
+    .handle = [](BEd &ctx) {
+      auto &addr = ctx.current();
+      ctx.buffer(addr.buffername).number_print(ctx, addr.number, addr.number);
+    }
+  };
+  ctx.suffixes['l' - 'a'] = Suffix{
+    .desc = "Prints current line unambiguously.",
+    .handle = [](BEd &ctx) {
+      auto &addr = ctx.current();
+      ctx.buffer(addr.buffername).list_print(ctx, addr.number, addr.number);
+    }
+  };
+}
+
+void Function::register_posix(BEd &ctx) {
+  ctx.functions.insert(
+    "a",
+    Function{
+      .address_kind = Function::AddressKind::Line,
+      .argument_kind = Function::ArgumentKind::None,
+      .input_mode = Function::InputMode::Text,
+      .desc = "Append text to a line",
+      .default_address = ".",
+      .accept_zero = true,
+      .pre_text_mode = [](
+                         BEd &ctx,
+                         const buffer::Address &addr_,
+                         const Argument &
+                       ) -> std::tuple<vase::Shard *, syntax::Language *, void *> {
+        const auto &addr = std::get<buffer::Line>(addr_);
+        auto &buf_ = ctx.buffer(addr.buffername);
+        if (buf_.kind != buffer::Buffer::Kind::Generic)
+          return {nullptr, nullptr, nullptr};
+        auto &buf = *(buffer::GenericBuffer *)&buf_;
+        void *state = syntax::state_before(buf.parse, buf.root, addr.number);
+        return {nullptr, buf.parse.lang, state};
+      },
+      .handle = [](
+                  BEd &ctx,
+                  const buffer::Address &addr_,
+                  vase::Shard *text,
+                  const Argument &,
+                  std::vector<buffer::Line> *
+                ) {
+        auto addr = std::get<buffer::Line>(addr_);
+        ctx.buffer(addr.buffername).append(ctx, text, addr.number);
+        vase::Shard::release(text); }
+    }
+  );
+  ctx.functions.insert(
+    "c",
+    Function{
+      .address_kind = Function::AddressKind::Range,
+      .argument_kind = Function::ArgumentKind::None,
+      .input_mode = Function::InputMode::Text,
+      .desc = "Change a range of lines",
+      .default_address = ".,.",
+      .accept_zero = false,
+      .pre_text_mode = [](
+                         BEd &ctx,
+                         const buffer::Address &addr_,
+                         const Argument &
+                       ) -> std::tuple<vase::Shard *, syntax::Language *, void *> {
+        const auto &addr = std::get<buffer::Range>(addr_);
+        auto &buf_ = ctx.buffer(addr.buffername);
+        if (buf_.kind != buffer::Buffer::Kind::Generic)
+          return {buf_.copy(addr.start, addr.end), nullptr, nullptr};
+        auto &buf = *(buffer::GenericBuffer *)&buf_;
+        void *state = syntax::state_before(buf.parse, buf.root, addr.start - 1);
+        return {buf.copy(addr.start, addr.end), buf.parse.lang, state};
+      },
+      .handle = [](
+                  BEd &ctx,
+                  const buffer::Address &addr_,
+                  vase::Shard *text,
+                  const Argument &,
+                  std::vector<buffer::Line> *
+                ) {
+        const auto &addr = std::get<buffer::Range>(addr_);
+        ctx.buffer(addr.buffername).replace(ctx, text, addr.start, addr.end);
+        vase::Shard::release(text); }
+    }
+  );
+  ctx.functions.insert(
+    "d",
+    Function{
+      .address_kind = Function::AddressKind::Range,
+      .argument_kind = Function::ArgumentKind::None,
+      .input_mode = Function::InputMode::None,
+      .desc = "Delete a range of lines",
+      .default_address = ".,.",
+      .accept_zero = false,
+      .pre_text_mode = nullptr,
+      .handle = [](
+                  BEd &ctx,
+                  const buffer::Address &addr_,
+                  vase::Shard *,
+                  const Argument &,
+                  std::vector<buffer::Line> *
+                ) {
+        auto addr = std::get<buffer::Range>(addr_);
+        ctx.buffer(addr.buffername).remove(ctx, addr.start, addr.end);
+      }
+    }
+  );
+  ctx.functions.insert(
+    "e",
+    Function{
+      .address_kind = Function::AddressKind::None,
+      .argument_kind = Function::ArgumentKind::File,
+      .input_mode = Function::InputMode::None,
+      .desc = "Load a file into the current buffer, warn once if unsaved changes exist",
+      .default_address = "",
+      .accept_zero = false,
+      .pre_text_mode = nullptr,
+      .handle = [](
+                  BEd &ctx,
+                  const buffer::Address &addr_,
+                  vase::Shard *,
+                  const Argument &arg,
+                  std::vector<buffer::Line> *
+                ) {
+        auto &addr = std::get<std::string>(addr_);
+        auto &buf = ctx.buffer(addr);
+        if (buf.state == buffer::Buffer::Modified) {
+          buf.state = buffer::Buffer::Warned;
+          throw ed_error("Buffer modified.");
+        }
+        vase::Shard *s = nullptr;
+        if (std::holds_alternative<std::filesystem::path>(arg)) {
+          auto path = std::get<std::filesystem::path>(arg);
+          s = vase::Shard::from_file(path);
+          buf.set_filename(path);
+        } else if (std::holds_alternative<ShellArg>(arg)) {
+          auto cmd = std::get<ShellArg>(arg).cmd;
+          ctx.escape_command(cmd, buf.filename().string());
+          s = vase::Shard::from_command(cmd.c_str());
+        } else {
+          auto path = buf.filename();
+          if (path.empty())
+            throw ed_error("Need filename.");
+          s = vase::Shard::from_file(path);
+        };
+        try {
+          buf.load(ctx, s);
+          vase::Shard::release(s);
+        } catch (...) {
+          vase::Shard::release(s);
+          throw;
+        }
+        if (!ctx.suppress_mode)
+          ctx.io.write_line(std::format("{}", buf.bytes()));
+      }
+    }
+  );
+  ctx.functions.insert(
+    "E",
+    Function{
+      .address_kind = Function::AddressKind::None,
+      .argument_kind = Function::ArgumentKind::File,
+      .input_mode = Function::InputMode::None,
+      .desc = "Load a file into the current buffer, discarding unsaved changes",
+      .default_address = "",
+      .accept_zero = false,
+      .pre_text_mode = nullptr,
+      .handle = [](
+                  BEd &ctx,
+                  const buffer::Address &addr_,
+                  vase::Shard *,
+                  const Argument &arg,
+                  std::vector<buffer::Line> *
+                ) {
+        auto &addr = std::get<std::string>(addr_);
+        auto &buf = ctx.buffer(addr);
+        vase::Shard *s = nullptr;
+        if (std::holds_alternative<std::filesystem::path>(arg)) {
+          auto path = std::get<std::filesystem::path>(arg);
+          s = vase::Shard::from_file(path);
+          buf.set_filename(path);
+        } else if (std::holds_alternative<ShellArg>(arg)) {
+          auto cmd = std::get<ShellArg>(arg).cmd;
+          ctx.escape_command(cmd, buf.filename().string());
+          s = vase::Shard::from_command(cmd.c_str());
+        } else {
+          auto path = buf.filename();
+          if (path.empty())
+            throw ed_error("Need filename.");
+          s = vase::Shard::from_file(path);
+        };
+        try {
+          buf.load(ctx, s);
+          vase::Shard::release(s);
+        } catch (...) {
+          vase::Shard::release(s);
+          throw;
+        }
+        if (!ctx.suppress_mode)
+          ctx.io.write_line(std::format("{}", buf.bytes()));
+      }
+    }
+  );
+  ctx.functions.insert(
+    "f",
+    Function{
+      .address_kind = Function::AddressKind::None,
+      .argument_kind = Function::ArgumentKind::File,
+      .input_mode = Function::InputMode::None,
+      .desc = "Set/print a save path",
+      .default_address = "",
+      .accept_zero = false,
+      .pre_text_mode = nullptr,
+      .handle = [](
+                  BEd &ctx,
+                  const buffer::Address &addr_,
+                  vase::Shard *,
+                  const Argument &arg,
+                  std::vector<buffer::Line> *
+                ) {
+        auto &addr = std::get<std::string>(addr_);
+        auto &buf = ctx.buffer(addr);
+        if (std::holds_alternative<std::filesystem::path>(arg))
+          buf.set_filename(std::get<std::filesystem::path>(arg));
+        else if (std::holds_alternative<ShellArg>(arg))
+          throw ed_error("Can't save shell command as save path.");
+        if (buf.filename().empty())
+          throw ed_error("Filename needed.");
+        ctx.io.write_line(buf.filename().string());
+      }
+    }
+  );
+  ctx.functions.insert(
+    "h",
+    Function{
+      .address_kind = Function::AddressKind::None,
+      .argument_kind = Function::ArgumentKind::None,
+      .input_mode = Function::InputMode::None,
+      .desc = "Print last help message",
+      .default_address = "",
+      .accept_zero = false,
+      .pre_text_mode = nullptr,
+      .handle = [](
+                  BEd &ctx,
+                  const buffer::Address &,
+                  vase::Shard *,
+                  const Argument &,
+                  std::vector<buffer::Line> *
+                ) {
+        ctx.io.apply(internal::io::Token::Warning);
+        ctx.io.write_line(ctx.last_help);
+        ctx.io.reset();
+      }
+    }
+  );
+  ctx.functions.insert(
+    "H",
+    Function{
+      .address_kind = Function::AddressKind::None,
+      .argument_kind = Function::ArgumentKind::None,
+      .input_mode = Function::InputMode::None,
+      .desc = "Toggle help mode",
+      .default_address = "",
+      .accept_zero = false,
+      .pre_text_mode = nullptr,
+      .handle = [](
+                  BEd &ctx,
+                  const buffer::Address &,
+                  vase::Shard *,
+                  const Argument &,
+                  std::vector<buffer::Line> *
+                ) {
+        ctx.help_mode = !ctx.help_mode;
+        ctx.io.apply(internal::io::Token::Warning);
+        if (ctx.help_mode)
+          ctx.io.write_line(ctx.last_help);
+        ctx.io.reset();
+      }
+    }
+  );
+  ctx.functions.insert(
+    "i",
+    Function{
+      .address_kind = Function::AddressKind::Line,
+      .argument_kind = Function::ArgumentKind::None,
+      .input_mode = Function::InputMode::Text,
+      .desc = "Insert text before a line",
+      .default_address = ".",
+      .accept_zero = true,
+      .pre_text_mode = [](
+                         BEd &ctx,
+                         const buffer::Address &addr_,
+                         const Argument &
+                       ) -> std::tuple<vase::Shard *, syntax::Language *, void *> {
+        auto addr = std::get<buffer::Line>(addr_);
+        if (addr.number)
+          addr.number--;
+        auto &buf_ = ctx.buffer(addr.buffername);
+        if (buf_.kind != buffer::Buffer::Kind::Generic)
+          return {nullptr, nullptr, nullptr};
+        auto &buf = *(buffer::GenericBuffer *)&buf_;
+        void *state = syntax::state_before(buf.parse, buf.root, addr.number);
+        return {nullptr, buf.parse.lang, state};
+      },
+      .handle = [](
+                  BEd &ctx,
+                  const buffer::Address &addr_,
+                  vase::Shard *text,
+                  const Argument &,
+                  std::vector<buffer::Line> *
+                ) {
+        auto addr = std::get<buffer::Line>(addr_);
+        if (addr.number)
+          addr.number--;
+        ctx.buffer(addr.buffername).append(ctx, text, addr.number);
+        vase::Shard::release(text); }
+    }
+  );
+  ctx.functions.insert(
+    "j",
+    Function{
+      .address_kind = Function::AddressKind::Range,
+      .argument_kind = Function::ArgumentKind::None,
+      .input_mode = Function::InputMode::None,
+      .desc = "Join a range of lines",
+      .default_address = ".,.+1",
+      .accept_zero = false,
+      .pre_text_mode = nullptr,
+      .handle = [](
+                  BEd &ctx,
+                  const buffer::Address &addr_,
+                  vase::Shard *,
+                  const Argument &,
+                  std::vector<buffer::Line> *
+                ) {
+        auto addr = std::get<buffer::Range>(addr_);
+        ctx.buffer(addr.buffername).join(ctx, addr.start, addr.end);
+      }
+    }
+  );
+  ctx.functions.insert(
+    "k",
+    Function{
+      .address_kind = Function::AddressKind::Line,
+      .argument_kind = Function::ArgumentKind::Mark,
+      .input_mode = Function::InputMode::None,
+      .desc = "Mark a line",
+      .default_address = ".",
+      .accept_zero = false,
+      .pre_text_mode = nullptr,
+      .handle = [](
+                  BEd &ctx,
+                  const buffer::Address &addr_,
+                  vase::Shard *,
+                  const Argument &arg,
+                  std::vector<buffer::Line> *
+                ) {
+        auto &addr = std::get<buffer::Line>(addr_);
+        ctx.mark(std::get<char>(arg), addr);
+      }
+    }
+  );
+  ctx.functions.insert(
+    "l",
+    Function{
+      .address_kind = Function::AddressKind::Range,
+      .argument_kind = Function::ArgumentKind::None,
+      .input_mode = Function::InputMode::None,
+      .desc = "Print a range, showing nonprinting characters unambiguously",
+      .default_address = ".,.",
+      .accept_zero = false,
+      .pre_text_mode = nullptr,
+      .handle = [](
+                  BEd &ctx,
+                  const buffer::Address &addr_,
+                  vase::Shard *,
+                  const Argument &,
+                  std::vector<buffer::Line> *
+                ) {
+        auto addr = std::get<buffer::Range>(addr_);
+        ctx.buffer(addr.buffername).list_print(ctx, addr.start, addr.end);
+        ctx.current() = {addr.buffername, addr.end};
+      },
+    }
+  );
+  ctx.functions.insert(
+    "m",
+    Function{
+      .address_kind = Function::AddressKind::Range,
+      .argument_kind = Function::ArgumentKind::Line,
+      .input_mode = Function::InputMode::None,
+      .desc = "Move a range of lines",
+      .default_address = ".,.",
+      .accept_zero = false,
+      .pre_text_mode = nullptr,
+      .handle = [](
+                  BEd &ctx,
+                  const buffer::Address &addr_,
+                  vase::Shard *,
+                  const Argument &arg_,
+                  std::vector<buffer::Line> *
+                ) {
+        auto addr = std::get<buffer::Range>(addr_);
+        auto arg = std::get<buffer::Line>(arg_);
+        if (arg.buffername == addr.buffername
+            && arg.number >= addr.start && arg.number < addr.end)
+          throw ed_error("Can't move lines within themselves.");
+        auto text = ctx.buffer(addr.buffername).copy(addr.start, addr.end);
+        ctx.mark(252, arg);
+        ctx.buffer(addr.buffername).remove(ctx, addr.start, addr.end);
+        arg = ctx.marks.get(252);
+        try {
+          if (arg.number == UINT64_MAX)
+            throw ed_error("Unexpected error when moving lines.");
+          ctx.buffer(arg.buffername).append(ctx, text, arg.number);
+          vase::Shard::release(text);
+        } catch (...) {
+          if (!addr.start) {
+            vase::Shard::release(text);
+            throw;
+          }
+          ctx.buffer(addr.buffername).append(ctx, text, --addr.start);
+          vase::Shard::release(text);
+          throw;
+        }
+      },
+    }
+  );
+  ctx.functions.insert(
+    "n",
+    Function{
+      .address_kind = Function::AddressKind::Range,
+      .argument_kind = Function::ArgumentKind::None,
+      .input_mode = Function::InputMode::None,
+      .desc = "Print a range with line numbers",
+      .default_address = ".,.",
+      .accept_zero = false,
+      .pre_text_mode = nullptr,
+      .handle = [](
+                  BEd &ctx,
+                  const buffer::Address &addr_,
+                  vase::Shard *,
+                  const Argument &,
+                  std::vector<buffer::Line> *
+                ) {
+        auto addr = std::get<buffer::Range>(addr_);
+        ctx.buffer(addr.buffername).number_print(ctx, addr.start, addr.end);
+        ctx.current() = {addr.buffername, addr.end};
+      },
+    }
+  );
+  ctx.functions.insert(
+    "p",
+    Function{
+      .address_kind = Function::AddressKind::Range,
+      .argument_kind = Function::ArgumentKind::None,
+      .input_mode = Function::InputMode::None,
+      .desc = "Print a range",
+      .default_address = ".,.",
+      .accept_zero = false,
+      .pre_text_mode = nullptr,
+      .handle = [](
+                  BEd &ctx,
+                  const buffer::Address &addr_,
+                  vase::Shard *,
+                  const Argument &,
+                  std::vector<buffer::Line> *
+                ) {
+        auto addr = std::get<buffer::Range>(addr_);
+        ctx.buffer(addr.buffername).print(ctx, addr.start, addr.end);
+        ctx.current() = {addr.buffername, addr.end};
+      },
+    }
+  );
+  ctx.functions.insert(
+    "P",
+    Function{
+      .address_kind = Function::AddressKind::None,
+      .argument_kind = Function::ArgumentKind::Any,
+      .input_mode = Function::InputMode::None,
+      .desc = "Toggle/set prompt string",
+      .default_address = "",
+      .accept_zero = false,
+      .pre_text_mode = nullptr,
+      .handle = [](
+                  BEd &ctx,
+                  const buffer::Address &,
+                  vase::Shard *,
+                  const Argument &arg_,
+                  std::vector<buffer::Line> *
+                ) {
+        auto &arg = std::get<std::string>(arg_);
+        if (arg.size()) {
+          ctx.prompt_mode = true;
+          ctx.prompt = [arg](BEd &) { return arg; };
+          return;
+        }
+        ctx.prompt_mode = !ctx.prompt_mode;
+        if (ctx.prompt_mode && !ctx.prompt)
+          ctx.prompt = [](BEd &) { return "*"; };
+      }
+    }
+  );
+  ctx.functions.insert(
+    "q",
+    Function{
+      .address_kind = Function::AddressKind::None,
+      .argument_kind = Function::ArgumentKind::None,
+      .input_mode = Function::InputMode::None,
+      .desc = "Quit, warn once if unsaved changes exist",
+      .default_address = "",
+      .accept_zero = false,
+      .pre_text_mode = nullptr,
+      .handle = [](
+                  BEd &ctx,
+                  const buffer::Address &,
+                  vase::Shard *,
+                  const Argument &,
+                  std::vector<buffer::Line> *
+                ) {
+        std::string modified_buffers;
+        for (auto &[name, buffer] : ctx.buffers) {
+          if (buffer->state == buffer::Buffer::Modified) {
+            buffer->state = buffer::Buffer::Warned;
+            modified_buffers.append(name + ", ");
+          }
+        }
+        if (!modified_buffers.size())
+          throw fatal_error("Quitting", 0);
+        modified_buffers.erase(modified_buffers.size() - 2);
+        throw ed_error("Buffer(s) " + modified_buffers + " modified.");
+      }
+    }
+  );
+  ctx.functions.insert(
+    "Q",
+    Function{
+      .address_kind = Function::AddressKind::None,
+      .argument_kind = Function::ArgumentKind::None,
+      .input_mode = Function::InputMode::None,
+      .desc = "Quit without saving, discarding unsaved changes",
+      .default_address = "",
+      .accept_zero = false,
+      .pre_text_mode = nullptr,
+      .handle = [](
+                  BEd &,
+                  const buffer::Address &,
+                  vase::Shard *,
+                  const Argument &,
+                  std::vector<buffer::Line> *
+                ) {
+        throw fatal_error("Force Quitting", 0);
+      }
+    }
+  );
+  ctx.functions.insert(
+    "r",
+    Function{
+      .address_kind = Function::AddressKind::Line,
+      .argument_kind = Function::ArgumentKind::File,
+      .input_mode = Function::InputMode::None,
+      .desc = "Read a file's contents into the buffer after the given address",
+      .default_address = "$",
+      .accept_zero = true,
+      .pre_text_mode = nullptr,
+      .handle = [](
+                  BEd &ctx,
+                  const buffer::Address &addr_,
+                  vase::Shard *,
+                  const Argument &arg,
+                  std::vector<buffer::Line> *
+                ) {
+        auto &addr = std::get<buffer::Line>(addr_);
+        auto &buf = ctx.buffer(addr.buffername);
+        vase::Shard *s = nullptr;
+        if (std::holds_alternative<std::filesystem::path>(arg)) {
+          auto path = std::get<std::filesystem::path>(arg);
+          s = vase::Shard::from_file(path);
+          if (buf.filename().empty())
+            buf.set_filename(path);
+        } else if (std::holds_alternative<ShellArg>(arg)) {
+          auto cmd = std::get<ShellArg>(arg).cmd;
+          ctx.escape_command(cmd, buf.filename().string());
+          s = vase::Shard::from_command(cmd.c_str());
+        } else {
+          auto path = buf.filename();
+          if (path.empty())
+            throw ed_error("Need filename.");
+          s = vase::Shard::from_file(path);
+        };
+        try {
+          buf.append(ctx, s, addr.number);
+          vase::Shard::release(s);
+        } catch (...) {
+          vase::Shard::release(s);
+          throw;
+        }
+        if (!ctx.suppress_mode)
+          ctx.io.write_line(std::format("{}", s ? s->length + 1 : 0));
+      }
+    }
+  );
+  ctx.functions.insert(
+    "s",
+    Function{
+      .address_kind = Function::AddressKind::Range,
+      .argument_kind = Function::ArgumentKind::Regex,
+      .input_mode = Function::InputMode::None,
+      .desc = "Substitute pattern in range for replacement",
+      .default_address = ".,.",
+      .accept_zero = false,
+      .pre_text_mode = nullptr,
+      .handle = [](
+                  BEd &ctx,
+                  const buffer::Address &addr_,
+                  vase::Shard *,
+                  const Argument &arg_,
+                  std::vector<buffer::Line> *
+                ) {
+        auto &addr = std::get<buffer::Range>(addr_);
+        auto arg = std::get<RegexArg>(arg_);
+        if (arg.expression == "")
+          arg.expression = ctx.last_regex;
+        else
+          ctx.last_regex = arg.expression;
+        if (arg.replacement == "%")
+          arg.replacement = ctx.last_replacement;
+        else
+          ctx.last_replacement = arg.replacement;
+        ctx.buffer(addr.buffername)
+          .substitute(
+            ctx,
+            addr.start,
+            addr.end,
+            arg.expression,
+            arg.replacement,
+            arg.options
+          );
+      }
+    }
+  );
+  ctx.functions.insert(
+    "t",
+    Function{
+      .address_kind = Function::AddressKind::Range,
+      .argument_kind = Function::ArgumentKind::Line,
+      .input_mode = Function::InputMode::None,
+      .desc = "Copy a range of lines",
+      .default_address = ".,.",
+      .accept_zero = false,
+      .pre_text_mode = nullptr,
+      .handle = [](
+                  BEd &ctx,
+                  const buffer::Address &addr_,
+                  vase::Shard *,
+                  const Argument &arg_,
+                  std::vector<buffer::Line> *
+                ) {
+        auto addr = std::get<buffer::Range>(addr_);
+        auto arg = std::get<buffer::Line>(arg_);
+        auto text = ctx.buffer(addr.buffername).copy(addr.start, addr.end);
+        try {
+          ctx.buffer(arg.buffername).append(ctx, text, arg.number);
+          vase::Shard::release(text);
+        } catch (...) {
+          vase::Shard::release(text);
+          throw;
+        }
+      },
+    }
+  );
+  ctx.functions.insert(
+    "u",
+    Function{
+      .address_kind = Function::AddressKind::None,
+      .argument_kind = Function::ArgumentKind::None,
+      .input_mode = Function::InputMode::None,
+      .desc = "Undo the last modification to the buffer",
+      .default_address = "",
+      .accept_zero = false,
+      .pre_text_mode = nullptr,
+      .handle = [](
+                  BEd &ctx,
+                  const buffer::Address &addr_,
+                  vase::Shard *,
+                  const Argument &,
+                  std::vector<buffer::Line> *
+                ) {
+        auto &addr = std::get<std::string>(addr_);
+        auto &buf_ = ctx.buffer(addr);
+        if (buf_.kind != buffer::Buffer::Kind::Generic)
+          throw ed_error("Can't undo buffer");
+        auto &buf = *(buffer::GenericBuffer *)&buf_;
+        if (!buf.undo(ctx))
+          throw ed_error("Can't undo buffer.");
+      }
+    }
+  );
+  ctx.functions.insert(
+    "w",
+    Function{
+      .address_kind = Function::AddressKind::Range,
+      .argument_kind = Function::ArgumentKind::File,
+      .input_mode = Function::InputMode::None,
+      .desc = "Write a range of lines to disk",
+      .default_address = "0,$",
+      .accept_zero = true,
+      .pre_text_mode = nullptr,
+      .handle = [](
+                  BEd &ctx,
+                  const buffer::Address &addr_,
+                  vase::Shard *,
+                  const Argument &arg,
+                  std::vector<buffer::Line> *
+                ) {
+        auto addr = std::get<buffer::Range>(addr_);
+        auto &buf = ctx.buffer(addr.buffername);
+        vase::Shard *text;
+        if (!addr.start && !addr.end) {
+          text = nullptr;
+        } else {
+          if (!addr.start && addr.end)
+            addr.start = 1;
+          text = buf.copy(addr.start, addr.end);
+        }
+        try {
+          if (std::holds_alternative<std::filesystem::path>(arg)) {
+            auto path = std::get<std::filesystem::path>(arg);
+            vase::write_file(path, text);
+            buf.set_filename(path);
+          } else if (std::holds_alternative<ShellArg>(arg)) {
+            auto cmd = std::get<ShellArg>(arg).cmd;
+            ctx.escape_command(cmd, buf.filename().string());
+            vase::write_command(cmd.c_str(), text);
+          } else {
+            auto path = buf.filename();
+            if (path.empty())
+              throw ed_error("Need filename.");
+            vase::write_file(path, text);
+          };
+          vase::Shard::release(text);
+        } catch (...) {
+          vase::Shard::release(text);
+          throw;
+        }
+        buf.saved_hook();
+        if (!ctx.suppress_mode)
+          ctx.io.write(std::format("{}\n", text ? text->length + 1 : 0));
+      }
+    }
+  );
+  ctx.functions.insert(
+    "=",
+    Function{
+      .address_kind = Function::AddressKind::Range,
+      .argument_kind = Function::ArgumentKind::None,
+      .input_mode = Function::InputMode::None,
+      .desc = "Print the line number of the given address",
+      .default_address = "$",
+      .accept_zero = true,
+      .pre_text_mode = nullptr,
+      .handle = [](
+                  BEd &ctx,
+                  const buffer::Address &addr_,
+                  vase::Shard *,
+                  const Argument &,
+                  std::vector<buffer::Line> *
+                ) {
+        auto &addr = std::get<buffer::Range>(addr_);
+        ctx.io.apply(io::Token::BufferName);
+        ctx.io.write(":" + addr.buffername + ":");
+        ctx.io.apply(io::Token::Number);
+        if (addr.start == addr.end) {
+          ctx.io.write_line(std::format(" {}", addr.start));
+        } else {
+          ctx.io.write(std::format(" {}", addr.start));
+          ctx.io.apply(io::Token::AddressSeperator);
+          ctx.io.write(",");
+          ctx.io.apply(io::Token::Number);
+          ctx.io.write_line(std::format("{}", addr.end));
+        }
+        ctx.io.reset();
+        ctx.prev().buffername = addr.buffername;
+        ctx.prev().start = addr.start;
+        ctx.prev().end = addr.end;
+        ctx.current() = {addr.buffername, addr.end};
+      },
+    }
+  );
+  ctx.functions.insert(
+    "!",
+    Function{
+      .address_kind = Function::AddressKind::None,
+      .argument_kind = Function::ArgumentKind::Shell,
+      .input_mode = Function::InputMode::None,
+      .desc = "Run a shell command",
+      .default_address = "",
+      .accept_zero = false,
+      .pre_text_mode = nullptr,
+      .handle = [](
+                  BEd &ctx,
+                  const buffer::Address &addr_,
+                  vase::Shard *,
+                  const Argument &arg_,
+                  std::vector<buffer::Line> *
+                ) {
+        auto &addr = std::get<std::string>(addr_);
+        auto filename = ctx.buffer(addr).filename();
+        auto &arg = std::get<ShellArg>(arg_);
+        auto cmd = arg.cmd;
+        if (ctx.escape_command(cmd, filename.string()))
+          ctx.io.write(cmd + "\n");
+        ctx.io.run_pty(cmd);
+        if (!ctx.suppress_mode)
+          ctx.io.write("!\n");
+      },
+    }
+  );
+  ctx.no_op = Function{
+    .address_kind = Function::AddressKind::Line,
+    .argument_kind = Function::ArgumentKind::None,
+    .input_mode = Function::InputMode::None,
+    .desc = "Print given line and move the cursor to it",
+    .default_address = ".+1",
+    .accept_zero = true,
+    .pre_text_mode = nullptr,
+    .handle = [](
+                BEd &ctx,
+                const buffer::Address &addr_,
+                vase::Shard *,
+                const Argument &,
+                std::vector<buffer::Line> *
+              ) {
+      auto addr = std::get<buffer::Line>(addr_);
+      if (addr.number != 0)
+        ctx.buffer(addr.buffername).print(ctx, addr.number, addr.number);
+      ctx.current() = addr;
+      ctx.prev().buffername = addr.buffername;
+      ctx.prev().start = addr.number;
+      ctx.prev().end = addr.number;
+    }
+  };
+  ctx.eof_op = Function{
+    .address_kind = Function::AddressKind::None,
+    .argument_kind = Function::ArgumentKind::None,
+    .input_mode = Function::InputMode::None,
+    .desc = "Quit, warn once if unsaved changes exist",
+    .default_address = "",
+    .accept_zero = false,
+    .pre_text_mode = nullptr,
+    .handle = [](
+                BEd &ctx,
+                const buffer::Address &,
+                vase::Shard *,
+                const Argument &,
+                std::vector<buffer::Line> *
+              ) {
+      std::string modified_buffers;
+      for (auto &[name, buffer] : ctx.buffers) {
+        if (buffer->state == buffer::Buffer::Modified) {
+          buffer->state = buffer::Buffer::Warned;
+          modified_buffers.append(name + ", ");
+        }
+      }
+      if (!modified_buffers.size())
+        throw fatal_error("Quitting", 0);
+      modified_buffers.erase(modified_buffers.size() - 2);
+      throw ed_error("Buffer(s) " + modified_buffers + " modified.");
+    }
+  };
+}
+} // namespace bed::internal::functions

src/internal/io/_command.cc

@@ -1,10 +0,0 @@
-#include "bed.h"
-#include "internal/io/command.h"
-#include "internal/io/io.h"
-
-namespace bed::internal::io {
-std::pair<std::string, bool> IO::get_command(BEd &ctx) {
-  CommandIO cio(ctx, *this);
-  return cio.run();
-}
-} // namespace bed::internal::io

src/internal/io/command.cc

@@ -1,156 +0,0 @@
-#include "bed.h"
-
-namespace bed::internal::io {
-/*template <typename F>
-static void for_each_cluster(std::string_view s, F &&f) {
-  unicode_width_state_t state;
-  unicode_width_init(&state);
-  size_t i = 0;
-  while (i < s.size()) {
-    unsigned char c = static_cast<unsigned char>(s[i]);
-    size_t bytes = 1;
-    int width = 0;
-    if (c < 128) {
-      width = unicode_width_process(&state, c);
-    } else {
-      uint_least32_t cp;
-      size_t decoded = grapheme_decode_utf8(s.data() + i, s.size() - i, &cp);
-      bytes = decoded > 0 ? decoded : 1;
-      width = unicode_width_process(&state, cp);
-    }
-    if (width < 0)
-      width = 0;
-    f(i, bytes, width);
-    i += bytes;
-  }
-}
-
-static int display_width(std::string_view s) {
-  int w = 0;
-  for_each_cluster(s, [&](size_t, size_t, int cw) { w += cw; });
-  return w;
-}
-
-static uint16_t count_clusters(std::string_view s) {
-  uint16_t n = 0;
-  for_each_cluster(s, [&](size_t, size_t, int) { ++n; });
-  return n;
-}
-
-static std::vector<uint16_t> wrap_offsets(std::string_view line, uint16_t avail) {
-  std::vector<uint16_t> offsets{0};
-  int col = 0;
-  for_each_cluster(line, [&](uint16_t i, uint16_t, int w) {
-    if (col + w > avail && col > 0) {
-      offsets.push_back(i);
-      col = 0;
-    }
-    col += w;
-  });
-  return offsets;
-}
-
-// The word under/before `byte_pos`, split on plain ASCII spaces. Used to
-// pick what prefix to hand the suggestion trie.
-// TODO: change to use libgrapheme word break here.
-static std::string current_word(const std::string &line, size_t byte_pos) {
-  size_t start = (byte_pos == 0) ? std::string::npos : line.rfind(' ', byte_pos - 1);
-  start = (start == std::string::npos) ? 0 : start + 1;
-  if (byte_pos < start)
-    byte_pos = start;
-  return line.substr(start, byte_pos - start);
-}*/
-
-CommandIO::CommandIO(BEd &bed, IO &io) : bed(bed), io(io) {
-  prompt = bed.prompt(bed);
-  cursor = 0;
-}
-
-std::pair<std::string, bool> CommandIO::run() {
-  auto [row, col] = io.cursor_position();
-  auto [rows, cols] = io.terminal_size();
-  if (row > rows)
-    throw fatal_error("Invalid cursor position.", 1);
-  start = row;
-  height = rows - row + 1;
-  term_width = cols;
-  term_height = rows;
-  redraw();
-
-  // main loop.
-  KeyEvent res;
-  bool running = true;
-  while (running) {
-    res = io.read_key();
-    switch (res.type) {
-    case KeyEvent::KeyType::EOF_:
-      running = false;
-      break;
-    case KeyEvent::KeyType::MOUSE:
-    case KeyEvent::KeyType::RESIZE:
-      break;
-    case KeyEvent::KeyType::CHAR:
-      switch (res.modifier) {
-      case KeyEvent::Modifier::SHIFT:
-      case KeyEvent::Modifier::ALT:
-      case KeyEvent::Modifier::CTRL_ALT:
-      case KeyEvent::Modifier::CTRL:
-        break;
-      case KeyEvent::Modifier::NONE:
-        if (res.text[0] == '\b' || res.text[0] == 0x7f) {
-          if (cursor > 0)
-            cmd.erase(--cursor, 1);
-        } else if (res.text[0] == '\n') {
-          running = false;
-        } else {
-          cmd.insert(cursor++, res.text);
-        }
-        break;
-      }
-      break;
-    case KeyEvent::KeyType::PASTE:
-      cmd.insert(cursor, res.text);
-      cursor += res.text.size();
-      break;
-    case KeyEvent::KeyType::SPECIAL:
-      switch (res.special_key) {
-      case KeyEvent::SpecialKey::UNKNOWN:
-      case KeyEvent::SpecialKey::UP:
-      case KeyEvent::SpecialKey::DOWN:
-        break;
-      case KeyEvent::SpecialKey::RIGHT:
-        if (cursor < cmd.size())
-          cursor++;
-        break;
-      case KeyEvent::SpecialKey::LEFT:
-        if (cursor > 0)
-          cursor--;
-        break;
-      case KeyEvent::SpecialKey::DELETE:
-        if (cursor < cmd.size())
-          cmd.erase(cursor, 1);
-        break;
-      }
-      break;
-    }
-    redraw();
-  }
-
-  for (uint16_t i = 1; i < height; ++i) {
-    io.move_cursor(start + i, 1);
-    io.write("\x1b[2K", 4);
-  }
-  io.move_cursor(start, 1);
-  io.write("\n", 1);
-  return {cmd, false};
-}
-
-void CommandIO::redraw() {
-  io.move_cursor(start, 1);
-  io.write("\x1b[2K", 4);
-  io.move_cursor(start, 1);
-  io.write(prompt);
-  io.write(cmd);
-  io.move_cursor(start, prompt.size() + cursor + 1);
-}
-} // namespace bed::internal::io

src/internal/io/input.cc

@@ -1,6 +1,33 @@
 #include "internal/io/io.h"
 
 namespace bed::internal::io {
+std::pair<std::string, bool> IO::read_pipe() {
+  char buf[4096];
+  while (true) {
+    auto pos = pipe_input.find('\n');
+    if (pos != std::string::npos) {
+      std::string line = pipe_input.substr(0, pos);
+      pipe_input.erase(0, pos + 1);
+      return {line, false};
+    }
+    ssize_t n = read(STDIN_FILENO, buf, sizeof(buf));
+    if (n > 0) {
+      pipe_input.append(buf, n);
+      continue;
+    }
+    if (n == 0) {
+      if (pipe_input.empty())
+        return {"", true};
+      std::string line = std::move(pipe_input);
+      pipe_input.clear();
+      return {line, false};
+    }
+    if (errno == EINTR)
+      continue;
+    throw fatal_error("Can't read stdin.", 1);
+  }
+}
+
 KeyEvent::ReadResult IO::get_next_byte(char &out) {
   if (!input_queue.empty()) {
     out = input_queue.front();

src/internal/io/io.cc

@@ -1,11 +1,17 @@
 #include "internal/io/io.h"
+#include "bed.h"
 
 namespace bed::internal::io {
 termios IO::orig_termios{};
-bool IO::cleaned = false;
+termios IO::raw_termios{};
+bool IO::cleaned = true;
 volatile std::atomic_bool IO::resized(false);
+IO::Mode IO::mode = IO::Mode::PIPE;
 
-IO::IO() {
+IO::IO(BEd &bed) : bed(bed) {
+  if (!isatty(STDIN_FILENO))
+    return;
+  mode = Mode::TERMINAL;
   if (tcgetattr(STDIN_FILENO, &orig_termios) == -1)
     throw fatal_error("Can't get terminal state.", 1);
   struct sigaction sa{};
@@ -14,16 +20,13 @@ IO::IO() {
   sa.sa_flags = 0;
   if (sigaction(SIGWINCH, &sa, nullptr) == -1)
     throw fatal_error("Can't install SIGWINCH handler.", 1);
-  struct termios raw = orig_termios;
-  raw.c_iflag &= ~(BRKINT | ISTRIP | IXON);
-  raw.c_cflag |= (CS8);
-  raw.c_lflag &= ~(ECHO | ICANON | ISIG);
-  raw.c_cc[VMIN] = 1;
-  raw.c_cc[VTIME] = 0;
-  if (tcsetattr(STDIN_FILENO, TCSAFLUSH, &raw) == -1)
-    throw fatal_error("Can't set terminal state.", 1);
-  std::string os = "\x1b[?2004h";
-  write_all(STDOUT_FILENO, os.c_str(), os.size());
+  raw_termios = orig_termios;
+  raw_termios.c_iflag &= ~(BRKINT | ISTRIP | IXON);
+  raw_termios.c_cflag |= (CS8);
+  raw_termios.c_lflag &= ~(ECHO | ICANON | ISIG);
+  raw_termios.c_cc[VMIN] = 1;
+  raw_termios.c_cc[VTIME] = 0;
+  enable_raw();
   atexit(cleanup);
 }
 
@@ -31,17 +34,54 @@ IO::~IO() {
   cleanup();
 }
 
+void IO::apply(const io::Token::Kind &t) {
+  if (!bed.color_mode)
+    return;
+  write("\x1b[0m");
+  const auto &hl = bed.theme.get(t);
+  const uint8_t r = (hl.fg >> 16) & 0xff;
+  const uint8_t g = (hl.fg >> 8) & 0xff;
+  const uint8_t b = hl.fg & 0xff;
+  write(std::format("\x1b[38;2;{};{};{}m", r, g, b));
+  if (hl.bg != 0) {
+    const uint8_t br = (hl.bg >> 16) & 0xff;
+    const uint8_t bg = (hl.bg >> 8) & 0xff;
+    const uint8_t bb = hl.bg & 0xff;
+    write(std::format("\x1b[48;2;{};{};{}m", br, bg, bb));
+  }
+  if (hl.flags & Highlight::Bold)
+    write("\x1b[1m");
+  if (hl.flags & Highlight::Italic)
+    write("\x1b[3m");
+  if (hl.flags & Highlight::Underline)
+    write("\x1b[4m");
+  if (hl.flags & Highlight::Strikethrough)
+    write("\x1b[9m");
+}
+
+void IO::reset() {
+  if (!bed.color_mode)
+    return;
+  write("\x1b[0m");
+}
+
 void IO::enable_mouse() {
+  if (mode == Mode::PIPE)
+    throw fatal_error("no mouse in pipe mode.", 1);
   const char *seq = "\x1b[?1000h";
   write_all(STDOUT_FILENO, seq, 8);
 }
 
 void IO::disable_mouse() {
+  if (mode == Mode::PIPE)
+    throw fatal_error("no mouse in pipe mode.", 1);
   const char *seq = "\x1b[?1000l";
   write_all(STDOUT_FILENO, seq, 8);
 }
 
 std::pair<uint16_t, uint16_t> IO::terminal_size() {
+  if (mode == Mode::PIPE)
+    throw fatal_error("no terminal size in pipe mode.", 1);
   struct winsize ws{};
   if (ioctl(STDOUT_FILENO, TIOCGWINSZ, &ws) == -1)
     throw fatal_error("Can't get terminal size.", 1);
@@ -49,6 +89,8 @@ std::pair<uint16_t, uint16_t> IO::terminal_size() {
 }
 
 std::pair<uint16_t, uint16_t> IO::cursor_position() {
+  if (mode == Mode::PIPE)
+    throw fatal_error("no cursor in pipe mode.", 1);
   write_all(STDOUT_FILENO, "\x1b[6n", 4);
   std::string response;
   char c;
@@ -70,8 +112,18 @@ std::pair<uint16_t, uint16_t> IO::cursor_position() {
   return {(uint16_t)row, (uint16_t)col};
 }
 
+void IO::enable_raw() {
+  if (!cleaned || mode == Mode::PIPE)
+    return;
+  std::string os = "\x1b[?2004h";
+  write_all(STDOUT_FILENO, os.c_str(), os.size());
+  if (tcsetattr(STDIN_FILENO, TCSAFLUSH, &raw_termios) == -1)
+    throw fatal_error("Can't set raw terminal state.", 1);
+  cleaned = false;
+}
+
 void IO::cleanup() {
-  if (cleaned)
+  if (cleaned || mode == Mode::PIPE)
     return;
   std::string os = "\x1b[?1000l\x1b[?2004l";
   write_all(STDOUT_FILENO, os.c_str(), os.size());
@@ -85,6 +137,8 @@ void IO::handle_sigwinch(int) {
 }
 
 void IO::move_cursor(uint16_t row, uint16_t col) {
+  if (mode == Mode::PIPE)
+    return;
   char buf[32];
   int n = snprintf(buf, sizeof(buf), "\x1b[%u;%uH", row, col);
   write_all(STDOUT_FILENO, buf, n);
@@ -97,4 +151,78 @@ void IO::write(const char *buf, uint64_t n) {
 void IO::write(std::string_view s) {
   write_all(STDOUT_FILENO, s.data(), s.size());
 }
+
+void IO::write_line(std::string_view s) {
+  write(s);
+  write("\n", 1);
+}
+
+void IO::run_pty(const std::string &cmd) {
+  if (mode == Mode::PIPE)
+    throw ed_error("Shell running not allowed in pipe mode.");
+  int master_fd = -1;
+  struct winsize ws{};
+  if (ioctl(STDOUT_FILENO, TIOCGWINSZ, &ws) == -1)
+    throw fatal_error("Can't get terminal size.", 1);
+  pid_t pid = forkpty(
+    &master_fd,
+    nullptr,
+    &orig_termios,
+    &ws
+  );
+  if (pid == -1)
+    throw fatal_error("Can't create PTY.", 1);
+  if (pid == 0) {
+    const char *shell = getenv("BED_SHELL");
+    if (!shell || !*shell)
+      shell = getenv("SHELL");
+    if (!shell || !*shell)
+      shell = "/bin/sh";
+    execl(shell, shell, "-i", "-c", cmd.c_str(), (char *)nullptr);
+    _exit(127);
+  }
+  struct pollfd fds[2];
+  while (true) {
+    fds[0].fd = STDIN_FILENO;
+    fds[0].events = POLLIN;
+    fds[1].fd = master_fd;
+    fds[1].events = POLLIN;
+    int rc = poll(fds, 2, -1);
+    if (rc == -1) {
+      if (errno == EINTR)
+        continue;
+      break;
+    }
+    if (resized.exchange(false)) {
+      struct winsize new_ws{};
+      if (ioctl(STDOUT_FILENO, TIOCGWINSZ, &new_ws) == 0)
+        ioctl(master_fd, TIOCSWINSZ, &new_ws);
+    }
+    if (fds[0].revents & POLLIN) {
+      char buf[4096];
+      ssize_t n = read(STDIN_FILENO, buf, sizeof(buf));
+      if (n > 0)
+        write_all(master_fd, buf, n);
+      else if (n == 0)
+        break;
+    }
+    if (fds[1].revents & POLLIN) {
+      char buf[8192];
+      ssize_t n = read(master_fd, buf, sizeof(buf));
+      if (n > 0)
+        write_all(STDOUT_FILENO, buf, n);
+      else
+        break;
+    }
+    if (fds[0].revents & (POLLERR | POLLHUP | POLLNVAL))
+      break;
+    if (fds[1].revents & (POLLERR | POLLHUP | POLLNVAL))
+      break;
+  }
+  close(master_fd);
+  int status;
+  while (waitpid(pid, &status, 0) == -1)
+    if (errno != EINTR)
+      break;
+}
 } // namespace bed::internal::io

src/internal/io/text_mode.cc

@@ -1,28 +0,0 @@
-#include "bed.h"
-#include "internal/io/io.h"
-
-namespace bed::internal::io {
-std::pair<std::string, bool> IO::get_text(BEd &) {
-  uint16_t start;
-  uint16_t height;
-  {
-    auto [row, col] = cursor_position();
-    auto [rows, cols] = terminal_size();
-    if (row > rows)
-      throw fatal_error("Invalid cursor position.", 1);
-    start = row;
-    height = rows - row + 1;
-  }
-  enable_mouse();
-  // uint16_t width = cols;
-
-  disable_mouse();
-  for (uint16_t i = 1; i < height; ++i) {
-    move_cursor(start + i, 1);
-    write_all(STDOUT_FILENO, "\x1b[2K", 4);
-  }
-  move_cursor(start, 1);
-  write_all(STDOUT_FILENO, "\n", 1);
-  return {"", true};
-}
-} // namespace bed::internal::io

src/internal/parser/address.cc

@@ -0,0 +1,302 @@
+#include "bed.h"
+#include "internal/parser/parser.h"
+
+namespace bed::internal::parser {
+void Parser::locator(AddressPromise &addr) {
+  addr.base = AddressPromise::None{};
+  switch (peek()) {
+  case '.':
+    token(io::Token::AddressSymbol);
+    advance();
+    end_token();
+    addr.base = AddressPromise::Current{};
+    break;
+  case '$':
+    token(io::Token::AddressSymbol);
+    advance();
+    end_token();
+    addr.base = AddressPromise::Last{};
+    break;
+  case '%':
+    token(io::Token::AddressSymbol);
+    advance();
+    end_token();
+    addr.base = AddressPromise::LastRange{};
+    break;
+  case '[':
+    token(io::Token::AddressSymbol);
+    advance();
+    end_token();
+    addr.base = AddressPromise::Block{Direction::Backward};
+    break;
+  case ']':
+    token(io::Token::AddressSymbol);
+    advance();
+    end_token();
+    addr.base = AddressPromise::Block{Direction::Forward};
+    break;
+  case '^':
+    token(io::Token::AddressSymbol);
+    advance();
+    end_token();
+    addr.base = AddressPromise::Diagnostic{Direction::Backward};
+    break;
+  case '~':
+    token(io::Token::AddressSymbol);
+    advance();
+    end_token();
+    addr.base = AddressPromise::Diagnostic{Direction::Forward};
+    break;
+  case '\'':
+    token(io::Token::Mark);
+    advance();
+    if (('a' <= peek() && peek() <= 'z')
+        || ('A' <= peek() && peek() <= 'Z'))
+      addr.base = AddressPromise::Mark{peek()};
+    else
+      throw ed_error("Valid mark needed after \'");
+    advance();
+    end_token();
+    break;
+  case '{': {
+    token(io::Token::AddressSymbol);
+    advance();
+    end_token();
+    uint16_t j = 0;
+    std::string func;
+    std::string arg;
+    token(io::Token::RubyFunction);
+    while (peek(j) != '}') {
+      if (peek(j) == '\0')
+        throw ed_error("Scripted address not terminated");
+      if (peek(j) == '\\')
+        ++j;
+      if (peek(j) == ':') {
+        func = peek_str(j);
+        advance(j + 1);
+        end_token();
+        token(io::Token::RubyArg);
+        j = 0;
+        continue;
+      }
+      ++j;
+    }
+    if (func.size())
+      arg = peek_str(j);
+    else
+      func = peek_str(j);
+    addr.base = AddressPromise::Scripted{std::move(func), std::move(arg)};
+    advance(j);
+    end_token();
+    token(io::Token::AddressSymbol);
+    advance();
+    end_token();
+  } break;
+  case '/': {
+    token(io::Token::Regexp);
+    advance();
+    uint64_t j = 0;
+    while (true) {
+      if (peek(j) == '\0')
+        break;
+      if (peek(j) == '/')
+        break;
+      else if (peek(j) == '\\')
+        j += 2;
+      else if (peek(j) == '[')
+        while (peek(j) != '\0' && cmd[i] != ']')
+          j++;
+      else
+        j++;
+    }
+    addr.base = AddressPromise::Regex(
+      Direction::Forward,
+      std::string(peek_str(j))
+    );
+    advance(j + 1);
+    end_token();
+  } break;
+  case '?': {
+    token(io::Token::Regexp);
+    advance();
+    uint16_t j = 0;
+    while (true) {
+      if (peek(j) == '\0')
+        break;
+      if (peek(j) == '?')
+        break;
+      else if (peek(j) == '\\')
+        j += 2;
+      else if (peek(j) == '[')
+        while (peek(j) != '\0' && cmd[i] != ']')
+          j++;
+      else
+        j++;
+    }
+    addr.base = AddressPromise::Regex(
+      Direction::Backward,
+      std::string(peek_str(j))
+    );
+    advance(j + 1);
+    end_token();
+  } break;
+  case '<': {
+    token(io::Token::Label);
+    advance();
+    uint16_t j = 0;
+    while (peek(j) != '>'
+           && peek(j) != '<'
+           && peek(j) != '\0')
+      j++;
+    switch (peek(j)) {
+    case '\0':
+    case '>':
+      addr.base = AddressPromise::SymbolDefinition{
+        std::string(peek_str(j))
+      };
+      break;
+    case '<':
+      addr.base = AddressPromise::SymbolReference{
+        Direction::Backward,
+        std::string(peek_str(j))
+      };
+      break;
+    }
+    advance(j + 1);
+    end_token();
+  } break;
+  case '>': {
+    token(io::Token::Label);
+    advance();
+    uint16_t j = 0;
+    while (peek(j) != '>' && peek(j) != '\0')
+      j++;
+    switch (peek(j)) {
+    case '\0':
+      throw ed_error("Unterminated symbol reference addressing.");
+    case '>':
+      addr.base = AddressPromise::SymbolReference{
+        Direction::Forward,
+        std::string(peek_str(j))
+      };
+      break;
+    }
+    advance(j + 1);
+    end_token();
+  } break;
+  case '+': {
+    token(io::Token::AddressSymbol);
+    advance();
+    end_token();
+    token(io::Token::Number);
+    addr.base = AddressPromise::Current{};
+    uint16_t j = 0;
+    uint64_t num = 0;
+    while ('0' <= peek(j) && peek(j) <= '9') {
+      num = num * 10 + (peek(j) - '0');
+      j++;
+    }
+    if (j == 0)
+      num = 1;
+    addr.offset += num;
+    advance(j);
+    end_token();
+  } break;
+  case '-': {
+    token(io::Token::AddressSymbol);
+    advance();
+    end_token();
+    token(io::Token::Number);
+    addr.base = AddressPromise::Current{};
+    uint16_t j = 0;
+    uint64_t num = 0;
+    while ('0' <= peek(j) && peek(j) <= '9') {
+      num = num * 10 + (peek(j) - '0');
+      j++;
+    }
+    if (j == 0)
+      num = 1;
+    addr.offset -= num;
+    advance(j);
+    end_token();
+  } break;
+  default:
+    if ('0' <= peek() && peek() <= '9') {
+      token(io::Token::Number);
+      uint64_t num = 0;
+      while ('0' <= peek() && peek() <= '9') {
+        num = num * 10 + (peek() - '0');
+        advance();
+      }
+      addr.base = AddressPromise::Number{num};
+      end_token();
+    }
+  }
+}
+
+int64_t Parser::offset() {
+  int64_t offset = 0;
+  while (peek() == '+' || peek() == '-'
+         || ('0' <= peek() && peek() <= '9')) {
+    bool positive = peek() != '-';
+    token(io::Token::AddressSymbol);
+    if (peek() == '+' || peek() == '-')
+      advance();
+    end_token();
+    token(io::Token::Number);
+    uint16_t j = 0;
+    int64_t num = 0;
+    while ('0' <= peek(j) && peek(j) <= '9')
+      num = num * 10 + (peek(j++) - '0');
+    if (j == 0)
+      num = 1;
+    advance(j);
+    end_token();
+    offset += positive ? num : -num;
+    skip_ws();
+  }
+  skip_ws();
+  return offset;
+}
+
+void Parser::address(AddressPromise &addr) {
+  if (peek() == ':') {
+    token(io::Token::BufferName);
+    advance();
+    uint16_t j = 0;
+    while (peek(j) != ':' && peek(j) != '\0')
+      j++;
+    addr.bufname = peek_str(j);
+    advance(j);
+    if (peek() == ':')
+      advance();
+    end_token();
+  }
+  skip_ws();
+  if (peek() == '\0')
+    return;
+  locator(addr);
+  skip_ws();
+  addr.offset += offset();
+}
+
+void Parser::addresses(std::vector<AddressPromise> &addresses) {
+  skip_ws();
+  addresses.push_back({});
+  auto *addr = &addresses.back();
+  address(*addr);
+  while (peek() == ',' || peek() == ';') {
+    addr->jumping = peek() == ';';
+    token(io::Token::AddressSeperator);
+    advance();
+    skip_ws();
+    addresses.push_back({});
+    addr = &addresses.back();
+    address(*addr);
+  }
+  if (addresses.size() == 1
+      && addr->offset == 0 && !addr->bufname.has_value()
+      && std::holds_alternative<AddressPromise::None>(addr->base))
+    addresses.pop_back();
+}
+} // namespace bed::internal::parser

src/internal/parser/address_promise.cc

@@ -6,13 +6,16 @@ namespace bed::internal::parser {
 buffer::Line AddressPromise::resolve(BEd &ctx) {
   buffer::Line result = std::visit(
     [&](auto const &addr) -> buffer::Line {
-      if (!bufname.has_value())
+      if (!bufname.has_value() || bufname->empty())
         throw ed_error("Buffer name can't be empty.");
       buffer::Line line = {*bufname, 0};
       auto &buf = ctx.buffer(line.buffername);
       using T = std::decay_t<decltype(addr)>;
       if constexpr (std::is_same_v<T, None>) {
-        throw ed_error("no address");
+        if (line.buffername == ctx.current().buffername)
+          line.number = ctx.current().number;
+        else
+          line.number = buf.lines();
       } else if constexpr (std::is_same_v<T, Current>) {
         if (line.buffername == ctx.current().buffername)
           line.number = ctx.current().number;
@@ -41,9 +44,9 @@ buffer::Line AddressPromise::resolve(BEd &ctx) {
         if (re.size() == 0)
           throw ed_error("No regex given.");
         if (addr.dir == Direction::Forward)
-          line.number = vase::find_next(buf.root, re, line.number);
+          line.number = buf.find_next(re, line.number);
         else
-          line.number = vase::find_prev(buf.root, re, line.number);
+          line.number = buf.find_prev(re, line.number);
         ctx.last_regex = re;
       } else if constexpr (std::is_same_v<T, Block>) {
         if (line.buffername == ctx.current().buffername)
@@ -52,28 +55,10 @@ buffer::Line AddressPromise::resolve(BEd &ctx) {
           line.number = buf.lines();
         if (buf.lines() > 0 && line.number == 0)
           line.number = 1;
-        if (addr.dir == Direction::Forward) {
-          if (buf.parser.has_value()) {
-            uint64_t closing = buf.parser->next_closing(line.number - 1);
-            if (closing == UINT64_MAX)
-              line.number = buf.lines();
+        if (addr.dir == Direction::Forward)
+          line.number = buf.next_closing(line.number);
         else
-              line.number = closing + 1;
-          } else {
-            line.number += 10;
-            if (line.number > buf.lines())
-              line.number = buf.lines();
-          }
-        } else {
-          if (buf.parser.has_value()) {
-            line.number = buf.parser->prev_opening(line.number - 1) + 1;
-          } else {
-            if (line.number > 10)
-              line.number -= 10;
-            else
-              line.number = 0;
-          }
-        }
+          line.number = buf.prev_closing(line.number);
       } else {
         throw ed_error("Unhandled address given.");
       }
@@ -96,16 +81,10 @@ std::optional<buffer::Line> AddressPromise::get_line(BEd &ctx, std::vector<Addre
   AddressPromise prev;
   for (std::size_t idx = 0; idx < list.size(); idx++) {
     AddressPromise &curr = list[idx];
-    if (curr.bufname.has_value()) {
-      if (curr.bufname->empty()) {
-        bufname = ctx.current().buffername;
+    if (!curr.bufname.has_value())
       curr.bufname = bufname;
-      } else {
-        bufname = *curr.bufname;
-      }
-    } else {
-      curr.bufname = bufname;
-    }
+    else if (curr.bufname->empty())
+      curr.bufname = bufname = ctx.current().buffername;
     bool is_final = idx + 1 == list.size();
     if (!is_final) {
       if (std::holds_alternative<None>(curr.base)) {
@@ -116,25 +95,24 @@ std::optional<buffer::Line> AddressPromise::get_line(BEd &ctx, std::vector<Addre
         curr.offset = 0;
         prev_given = false;
       } else if (std::holds_alternative<LastRange>(curr.base)) {
-        curr.bufname = ctx.prev.buffername;
-        curr.base = Number(ctx.prev.end);
+        curr.bufname = ctx.prev().buffername;
+        curr.base = Number(ctx.prev().end);
         prev_given = true;
       } else {
         prev_given = true;
       }
-      if (curr.jumping) {
       buffer::Line resolved = curr.resolve(ctx);
+      if (curr.jumping)
         ctx.current() = resolved;
       curr.bufname = resolved.buffername;
       curr.base = Number(resolved.number);
       curr.offset = 0;
-      }
       prev = curr;
       prev_set = true;
+      bufname = *curr.bufname;
     } else {
       if (std::holds_alternative<None>(curr.base)) {
-        if (!prev_set)
-          return std::nullopt;
+        if (prev_set) {
           if (prev_given) {
             curr.base = prev.base;
             curr.offset = prev.offset;
@@ -143,6 +121,10 @@ std::optional<buffer::Line> AddressPromise::get_line(BEd &ctx, std::vector<Addre
             curr.offset = 0;
           }
         }
+      } else if (std::holds_alternative<LastRange>(curr.base)) {
+        curr.bufname = ctx.prev().buffername;
+        curr.base = Number(ctx.prev().end);
+      }
       return curr.resolve(ctx);
     }
   }
@@ -156,16 +138,10 @@ std::optional<buffer::Range> AddressPromise::get_range(BEd &ctx, std::vector<Add
   AddressPromise prev;
   for (std::size_t idx = 0; idx < list.size(); idx++) {
     AddressPromise &curr = list[idx];
-    if (curr.bufname.has_value()) {
-      if (curr.bufname->empty()) {
-        bufname = ctx.current().buffername;
+    if (!curr.bufname.has_value())
       curr.bufname = bufname;
-      } else {
-        bufname = *curr.bufname;
-      }
-    } else {
-      curr.bufname = bufname;
-    }
+    else if (curr.bufname->empty())
+      curr.bufname = bufname = ctx.current().buffername;
     bool is_final = idx + 1 == list.size();
     if (!is_final) {
       if (std::holds_alternative<None>(curr.base)) {
@@ -176,25 +152,24 @@ std::optional<buffer::Range> AddressPromise::get_range(BEd &ctx, std::vector<Add
         curr.offset = 0;
         prev_given = false;
       } else if (std::holds_alternative<LastRange>(curr.base)) {
-        curr.bufname = ctx.prev.buffername;
-        curr.base = Number(ctx.prev.end);
+        curr.bufname = ctx.prev().buffername;
+        curr.base = Number(ctx.prev().end);
         prev_given = true;
       } else {
         prev_given = true;
       }
-      if (curr.jumping) {
       buffer::Line resolved = curr.resolve(ctx);
-        ctx.current() = resolved;
       curr.bufname = resolved.buffername;
       curr.base = Number(resolved.number);
       curr.offset = 0;
-      }
+      if (curr.jumping)
+        ctx.current() = resolved;
       prev = curr;
       prev_set = true;
+      bufname = *curr.bufname;
     } else {
       if (std::holds_alternative<None>(curr.base)) {
-        if (!prev_set)
-          return std::nullopt;
+        if (prev_set) {
           if (prev_given) {
             curr.base = prev.base;
             curr.offset = prev.offset;
@@ -204,6 +179,21 @@ std::optional<buffer::Range> AddressPromise::get_range(BEd &ctx, std::vector<Add
           }
           return buffer::Range(prev.resolve(ctx), curr.resolve(ctx));
         }
+      } else if (std::holds_alternative<LastRange>(curr.base)) {
+        auto previous = ctx.prev();
+        auto &buf = ctx.buffer(previous.buffername);
+        if (curr.offset < 0 && previous.start < (uint64_t)-curr.offset)
+          throw ed_error("Can't have negative addresses");
+        previous.start += curr.offset;
+        if (previous.start > buf.lines())
+          throw ed_error("Line number too high.");
+        if (curr.offset < 0 && previous.end < (uint64_t)-curr.offset)
+          throw ed_error("Can't have negative addresses");
+        previous.end += curr.offset;
+        if (previous.end > buf.lines())
+          throw ed_error("Line number too high.");
+        return previous;
+      }
       if (prev_given)
         return buffer::Range(prev.resolve(ctx), curr.resolve(ctx));
       buffer::Line only = curr.resolve(ctx);

src/internal/parser/operation.cc

@@ -0,0 +1,240 @@
+#include "bed.h"
+#include "internal/parser/parser.h"
+
+namespace bed::internal::parser {
+void Parser::operation() {
+  if (peek() == '\0') {
+    command->function = &bed.no_op;
+    return;
+  }
+  uint64_t len = bed.functions.longest_match(peek_str());
+  if (len == 0)
+    throw ed_error("Function not found.");
+  functions::Function *function = bed.functions.get_ptr(peek_str(len));
+  token(io::Token::Function);
+  advance(len);
+  end_token();
+  command->function = function;
+  char suffix = '\0';
+  switch (command->function->argument_kind) {
+  case functions::Function::ArgumentKind::None:
+    break;
+  case functions::Function::ArgumentKind::Number:
+    skip_ws();
+    command->argument = offset();
+    break;
+  case functions::Function::ArgumentKind::Mark:
+    if (('a' <= peek() && peek() <= 'z')
+        || ('A' <= peek() && peek() <= 'Z'))
+      command->argument = peek();
+    else
+      throw ed_error("Valid mark needed.");
+    token(io::Token::Mark);
+    advance();
+    end_token();
+    break;
+  case functions::Function::ArgumentKind::Any:
+    command->argument = std::string(peek_str());
+    token(io::Token::Data);
+    advance(peek_str().size());
+    end_token();
+    break;
+  case functions::Function::ArgumentKind::Global: {
+    char delim;
+    std::string val;
+    switch (peek()) {
+    case '\0':
+      throw ed_error("Command needs a delimited value.");
+    case '{': {
+      advance();
+      delim = '}';
+      uint16_t j = 0;
+      while (peek(j) != '}' && peek(j) != '\0') {
+        if (peek(j) == '\\')
+          j++;
+        j++;
+      }
+      switch (peek(j)) {
+      case '\0':
+        throw ed_error("Unterminated {");
+      case '}':
+        val = peek_str(j);
+        break;
+      }
+      advance(j + 1);
+    } break;
+    case '<': {
+      advance();
+      delim = '<';
+      uint16_t j = 0;
+      while (peek(j) != '>' || peek(j) != '\0') {
+        if (peek(j) == '\\')
+          j++;
+        j++;
+      }
+      switch (peek(j)) {
+      case '\0':
+        throw ed_error("Unterminated <");
+      case '>':
+        val = peek_str(j);
+        break;
+      }
+      advance(j + 1);
+    } break;
+    case '^':
+    case '~':
+      advance();
+      delim = '^';
+      break;
+    default:
+      delim = peek();
+      advance();
+      uint64_t j = 0;
+      while (true) {
+        if (peek(j) == '\0')
+          break;
+        if (peek(j) == delim)
+          break;
+        else if (peek(j) == '\\')
+          j += 2;
+        else if (peek(j) == '[')
+          while (peek(j) != '\0' && cmd[i] != ']')
+            j++;
+        else
+          j++;
+      }
+      val = peek_str(j);
+      advance(j + 1);
+    }
+    command->argument = functions::Function::GlobalArg(delim, std::move(val));
+  } break;
+  case functions::Function::ArgumentKind::File:
+    if (!(peek() == '\t' || peek() == ' ' || peek() == '\0'))
+      throw ed_error("Incorrect file input usage.");
+    skip_ws();
+    switch (peek()) {
+    case '!':
+      token(io::Token::Error);
+      advance();
+      end_token();
+      token(io::Token::Shell);
+      command->argument = functions::Function::ShellArg(std::string(peek_str()));
+      advance(peek_str().size());
+      end_token();
+      break;
+    case '\0':
+      command->argument = std::monostate();
+      break;
+    default:
+      token(io::Token::File);
+      command->argument = std::filesystem::path(peek_str());
+      advance(peek_str().size());
+      end_token();
+      break;
+    }
+    break;
+  case functions::Function::ArgumentKind::Line:
+    command->argument = buffer::Line();
+    addresses(command->argument_addresses);
+    break;
+  case functions::Function::ArgumentKind::Range:
+    command->argument = buffer::Range();
+    addresses(command->argument_addresses);
+    break;
+  case functions::Function::ArgumentKind::Regex: {
+    char delim = peek();
+    if (delim == '\0')
+      throw ed_error("regex expected");
+    token(io::Token::Regexp);
+    advance();
+    uint16_t j = 0;
+    while (true) {
+      if (peek(j) == '\0')
+        throw ed_error("Unterminated regex");
+      if (peek(j) == delim)
+        break;
+      else if (peek(j) == '\\')
+        j += 2;
+      else if (peek(j) == '[')
+        while (peek(j) != '\0' && peek(j) != ']')
+          j++;
+      else
+        j++;
+    }
+    std::string expression(peek_str(j));
+    advance(j + 1);
+    j = 0;
+    while (true) {
+      if (peek(j) == '\0')
+        break;
+      if (peek(j) == delim)
+        break;
+      else if (peek(j) == '\\')
+        j += 2;
+      else if (peek(j) == '[')
+        while (peek(j) != '\0' && peek(j) != ']')
+          j++;
+      else
+        j++;
+    }
+    std::string replacement(peek_str(j));
+    std::string options;
+    if (peek(j) != '\0') {
+      advance(j + 1);
+    } else {
+      advance(j);
+      options = "p";
+    }
+    end_token();
+    token(io::Token::Suffix);
+    if (peek() != '\0') {
+      options = std::string(peek_str());
+      advance(peek_str().size());
+    }
+    end_token();
+    std::erase_if(options, [&](char c) {
+      if (bed.suffixes[c - 'a'].has_value()) {
+        suffix = c;
+        return true;
+      }
+      return false;
+    });
+    command->argument = functions::Function::RegexArg(expression, replacement, options);
+  } break;
+  case functions::Function::ArgumentKind::Ruby: {
+    command->argument = functions::Function::RubyArg(std::string(peek_str()));
+    auto *ruby_parser = bed.languages["ruby"];
+    void *state = ruby_parser->none_state();
+    std::vector<syntax::ParseEvent> events;
+    std::vector<io::Token> tokens_;
+    ruby_parser->parse(&state, peek_str(), false, &tokens_, &events);
+    for (auto &token : tokens_) {
+      token.start += i;
+      token.end += i;
+      tokens->push_back(token);
+    }
+    ruby_parser->destroy(state);
+    advance(peek_str().size());
+  } break;
+  case functions::Function::ArgumentKind::Shell:
+    command->argument = functions::Function::ShellArg(std::string(peek_str()));
+    token(io::Token::Shell);
+    advance(peek_str().size());
+    end_token();
+    break;
+  }
+  if (!suffix) {
+    suffix = peek();
+    token(io::Token::Suffix);
+    advance();
+    end_token();
+  }
+  if (suffix) {
+    auto &s = bed.suffixes[suffix - 'a'];
+    if (s.has_value())
+      command->suffix = &s.value();
+    else
+      throw ed_error("Invalid suffix.");
+  }
+}
+} // namespace bed::internal::parser

src/internal/parser/parser.cc

@@ -2,6 +2,19 @@
 #include "bed.h"
 
 namespace bed::internal::parser {
+void Parser::token(io::Token::Kind k) {
+  end_token();
+  tokens->push_back({.start = i, .end = 0, .type = k});
+}
+
+void Parser::end_token() {
+  if (tokens->empty())
+    return;
+  auto &b = tokens->back();
+  if (!b.end)
+    b.end = i;
+}
+
 char Parser::peek(uint16_t o) {
   return i + o < cmd.size() ? cmd[i + o] : '\0';
 }
@@ -15,462 +28,16 @@ void Parser::advance(uint16_t c) {
 }
 
 void Parser::skip_ws() {
+  end_token();
   while (peek() == ' ' || peek() == '\t')
     advance();
 }
 
-void Parser::locator(AddressPromise &addr) {
-  addr.base = AddressPromise::None{};
-  switch (peek()) {
-  case '.':
-    advance();
-    addr.base = AddressPromise::Current{};
-    break;
-  case '$':
-    advance();
-    addr.base = AddressPromise::Last{};
-    break;
-  case '%':
-    advance();
-    addr.base = AddressPromise::LastRange{};
-    break;
-  case '[':
-    advance();
-    addr.base = AddressPromise::Block{Direction::Backward};
-    break;
-  case ']':
-    advance();
-    addr.base = AddressPromise::Block{Direction::Forward};
-    break;
-  case '^':
-    advance();
-    addr.base = AddressPromise::Diagnostic{Direction::Backward};
-    break;
-  case '~':
-    advance();
-    addr.base = AddressPromise::Diagnostic{Direction::Forward};
-    break;
-  case '\'':
-    advance();
-    if (('a' <= peek() && peek() <= 'z')
-        || ('A' <= peek() && peek() <= 'Z'))
-      addr.base = AddressPromise::Mark{peek()};
-    else
-      throw ed_error("Valid mark needed after \'");
-    advance();
-    break;
-  case '{': {
-    advance();
-    uint16_t j = 0;
-    std::string func;
-    std::string arg;
-    while (peek(j) != '}') {
-      if (peek(j) == '\0')
-        throw ed_error("Scripted address not terminated");
-      if (peek(j) == '\\')
-        ++j;
-      if (peek(j) == ':') {
-        func = peek_str(j);
-        advance(j + 1);
-        j = 0;
-        continue;
-      }
-      ++j;
-    }
-    if (func.size())
-      arg = peek_str(j);
-    else
-      func = peek_str(j);
-    addr.base = AddressPromise::Scripted{std::move(func), std::move(arg)};
-    advance(j + 1);
-  } break;
-  case '/': {
-    advance();
-    uint64_t j = 0;
-    while (true) {
-      if (peek(j) == '\0')
-        break;
-      if (peek(j) == '/')
-        break;
-      else if (peek(j) == '\\')
-        j += 2;
-      else if (peek(j) == '[')
-        while (peek(j) != '\0' && cmd[i] != ']')
-          j++;
-      else
-        j++;
-    }
-    addr.base = AddressPromise::Regex(
-      Direction::Forward,
-      std::string(peek_str(j))
-    );
-    advance(j + 1);
-  } break;
-  case '?': {
-    advance();
-    uint16_t j = 0;
-    while (true) {
-      if (peek(j) == '\0')
-        break;
-      if (peek(j) == '?')
-        break;
-      else if (peek(j) == '\\')
-        j += 2;
-      else if (peek(j) == '[')
-        while (peek(j) != '\0' && cmd[i] != ']')
-          j++;
-      else
-        j++;
-    }
-    addr.base = AddressPromise::Regex(
-      Direction::Backward,
-      std::string(peek_str(j))
-    );
-    advance(j + 1);
-  } break;
-  case '<': {
-    advance();
-    uint16_t j = 0;
-    while (peek(j) != '>'
-           && peek(j) != '<'
-           && peek(j) != '\0')
-      j++;
-    switch (peek(j)) {
-    case '\0':
-    case '>':
-      addr.base = AddressPromise::SymbolDefinition{
-        std::string(peek_str(j))
-      };
-      break;
-    case '<':
-      addr.base = AddressPromise::SymbolReference{
-        Direction::Backward,
-        std::string(peek_str(j))
-      };
-      break;
-    }
-    advance(j + 1);
-  } break;
-  case '>': {
-    advance();
-    uint16_t j = 0;
-    while (peek(j) != '>' && peek(j) != '\0')
-      j++;
-    switch (peek(j)) {
-    case '\0':
-      throw ed_error("Unterminated symbol reference addressing.");
-    case '>':
-      addr.base = AddressPromise::SymbolReference{
-        Direction::Forward,
-        std::string(peek_str(j))
-      };
-      break;
-    }
-    advance(j + 1);
-  } break;
-  case '+': {
-    advance();
-    addr.base = AddressPromise::Current{};
-    uint16_t j = 0;
-    uint64_t num = 0;
-    while ('0' <= peek(j) && peek(j) <= '9') {
-      num = num * 10 + (peek(j) - '0');
-      j++;
-    }
-    if (j == 0)
-      num = 1;
-    advance(j);
-    addr.offset += num;
-  } break;
-  case '-': {
-    advance();
-    addr.base = AddressPromise::Current{};
-    uint16_t j = 0;
-    uint64_t num = 0;
-    while ('0' <= peek(j) && peek(j) <= '9') {
-      num = num * 10 + (peek(j) - '0');
-      j++;
-    }
-    if (j == 0)
-      num = 1;
-    advance(j);
-    addr.offset -= num;
-  } break;
-  default:
-    if ('0' <= peek() && peek() <= '9') {
-      uint64_t num = 0;
-      while ('0' <= peek() && peek() <= '9') {
-        num = num * 10 + (peek() - '0');
-        advance();
-      }
-      addr.base = AddressPromise::Number{num};
-    }
-  }
-}
-
-int64_t Parser::offset() {
-  int64_t offset = 0;
-  while (peek() == '+' || peek() == '-'
-         || ('0' <= peek() && peek() <= '9')) {
-    bool positive = peek() != '-';
-    if (peek() == '+' || peek() == '-')
-      advance();
-    uint16_t j = 0;
-    int64_t num = 0;
-    while ('0' <= peek(j) && peek(j) <= '9')
-      num = num * 10 + (peek(j++) - '0');
-    if (j == 0)
-      num = 1;
-    advance(j);
-    offset += positive ? num : -num;
-    skip_ws();
-  }
-  skip_ws();
-  return offset;
-}
-
-void Parser::address(AddressPromise &addr) {
-  if (peek() == ':') {
-    advance();
-    uint16_t j = 0;
-    while (peek(j) != ':' && peek(j) != '\0')
-      j++;
-    addr.bufname = peek_str(j);
-    advance(j);
-    if (peek() == ':')
-      advance();
-  }
-  skip_ws();
-  if (peek() == '\0')
-    return;
-  locator(addr);
-  skip_ws();
-  addr.offset += offset();
-}
-
-void Parser::addresses(std::vector<AddressPromise> &addresses) {
-  skip_ws();
-  addresses.push_back({});
-  auto *addr = &addresses.back();
-  address(*addr);
-  while (peek() == ',' || peek() == ';') {
-    addr->jumping = peek() == ';';
-    advance();
-    skip_ws();
-    addresses.push_back({});
-    addr = &addresses.back();
-    address(*addr);
-  }
-  if (addresses.size() == 1
-      && addr->offset == 0 && addr->bufname.has_value()
-      && std::holds_alternative<AddressPromise::None>(addr->base))
-    addresses.pop_back();
-}
-
-void Parser::operation() {
-  if (peek() == '\0') {
-    command->function = &bed.no_op;
-    return;
-  }
-  uint64_t len = bed.functions.longest_match(peek_str());
-  if (len == 0)
-    throw ed_error("Function not found.");
-  functions::Function *function = bed.functions.get_ptr(peek_str(len));
-  advance(len);
-  command->function = function;
-  char suffix = '\0';
-  switch (command->function->argument_kind) {
-  case functions::Function::ArgumentKind::None:
-    break;
-  case functions::Function::ArgumentKind::Number:
-    skip_ws();
-    command->argument = offset();
-    break;
-  case functions::Function::ArgumentKind::Mark:
-    if (('a' <= peek() && peek() <= 'z')
-        || ('A' <= peek() && peek() <= 'Z'))
-      command->argument = peek();
-    else
-      throw ed_error("Valid mark needed.");
-    advance();
-    break;
-  case functions::Function::ArgumentKind::Any:
-    command->argument = std::string(peek_str());
-    advance(peek_str().size());
-    break;
-  case functions::Function::ArgumentKind::Global: {
-    char delim;
-    std::string val;
-    switch (peek()) {
-    case '\0':
-      throw ed_error("Command needs a delimited value.");
-    case '{': {
-      advance();
-      delim = '}';
-      uint16_t j = 0;
-      while (peek(j) != '}' && peek(j) != '\0') {
-        if (peek(j) == '\\')
-          j++;
-        j++;
-      }
-      switch (peek(j)) {
-      case '\0':
-        throw ed_error("Unterminated {");
-      case '}':
-        val = peek_str(j);
-        break;
-      }
-      advance(j + 1);
-    } break;
-    case '<': {
-      advance();
-      delim = '<';
-      uint16_t j = 0;
-      while (peek(j) != '>' || peek(j) != '\0') {
-        if (peek(j) == '\\')
-          j++;
-        j++;
-      }
-      switch (peek(j)) {
-      case '\0':
-        throw ed_error("Unterminated <");
-      case '>':
-        val = peek_str(j);
-        break;
-      }
-      advance(j + 1);
-    } break;
-    case '^':
-    case '~':
-      advance();
-      delim = '^';
-      break;
-    default:
-      delim = peek();
-      advance();
-      uint64_t j = 0;
-      while (true) {
-        if (peek(j) == '\0')
-          break;
-        if (peek(j) == delim)
-          break;
-        else if (peek(j) == '\\')
-          j += 2;
-        else if (peek(j) == '[')
-          while (peek(j) != '\0' && cmd[i] != ']')
-            j++;
-        else
-          j++;
-      }
-      val = peek_str(j);
-      advance(j + 1);
-    }
-    command->argument = functions::Function::GlobalArg(delim, std::move(val));
-  } break;
-  case functions::Function::ArgumentKind::File:
-    skip_ws();
-    switch (peek()) {
-    case '!':
-      advance();
-      command->argument = functions::Function::ShellArg(std::string(peek_str()));
-      advance(peek_str().size());
-      break;
-    case '\0':
-      command->argument = std::monostate();
-      break;
-    default:
-      command->argument = std::filesystem::path(peek_str());
-      advance(peek_str().size());
-      break;
-    }
-    break;
-  case functions::Function::ArgumentKind::Line:
-    command->argument = buffer::Line();
-    addresses(command->argument_addresses);
-    break;
-  case functions::Function::ArgumentKind::Range:
-    command->argument = buffer::Range();
-    addresses(command->argument_addresses);
-    break;
-  case functions::Function::ArgumentKind::Regex: {
-    char delim = peek();
-    if (delim == '\0')
-      throw ed_error("regex expected");
-    advance();
-    uint64_t j = 0;
-    while (true) {
-      if (peek(j) == '\0')
-        throw ed_error("Unterminated regex");
-      if (peek(j) == delim)
-        break;
-      else if (peek(j) == '\\')
-        j += 2;
-      else if (peek(j) == '[')
-        while (peek(j) != '\0' && cmd[i] != ']')
-          j++;
-      else
-        j++;
-    }
-    std::string expression(peek_str(j));
-    advance(j + 1);
-    j = 0;
-    while (true) {
-      if (peek(j) == '\0')
-        break;
-      if (peek(j) == delim)
-        break;
-      else if (peek(j) == '\\')
-        j += 2;
-      else if (peek(j) == '[')
-        while (peek(j) != '\0' && cmd[i] != ']')
-          j++;
-      else
-        j++;
-    }
-    std::string replacement;
-    if (peek(j) != '\0') {
-      replacement = peek_str(j);
-      advance(j + 1);
-    }
-    std::string options;
-    if (peek() != '\0') {
-      options = std::string(peek_str());
-      advance(peek_str().size());
-    }
-    std::erase_if(options, [&](char c) {
-      if (bed.suffixes[c - 'a'].has_value()) {
-        suffix = c;
-        return true;
-      }
-      return false;
-    });
-    command->argument = functions::Function::RegexArg(expression, replacement, options);
-  } break;
-  case functions::Function::ArgumentKind::Ruby:
-    command->argument = functions::Function::RubyArg(std::string(peek_str()));
-    advance(peek_str().size());
-    break;
-  case functions::Function::ArgumentKind::Shell:
-    command->argument = functions::Function::ShellArg(std::string(peek_str()));
-    advance(peek_str().size());
-    break;
-  }
-  if (!suffix) {
-    suffix = peek();
-    advance();
-  }
-  if (suffix) {
-    auto &s = bed.suffixes[suffix - 'a'];
-    if (s.has_value())
-      command->suffix = &s.value();
-    else
-      throw ed_error("Invalid suffix.");
-  }
-}
-
 void Parser::parse() {
+  try {
     skip_ws();
     if (peek() == '@') {
+      token(io::Token::TempCurrent);
       advance();
       command->temp_address = true;
     } else {
@@ -480,9 +47,18 @@ void Parser::parse() {
     addresses(command->addresses);
     operation();
     skip_ws();
-  if (peek() != '\0')
+    if (peek() != '\0') {
+      token(io::Token::Error);
       throw ed_error("Malformed command");
     }
+    advance(cmd.size() - i);
+    end_token();
+  } catch (const ed_error &e) {
+    advance(cmd.size() - i);
+    end_token();
+    throw;
+  }
+}
 
 Parser::Parser(
   std::string_view cmd, BEd &bed, Command *command,
@@ -491,6 +67,18 @@ Parser::Parser(
   i = 0;
 }
 
+std::vector<io::Token> Parser::get_highlight(std::string_view cmd, BEd &bed) {
+  Command c;
+  std::vector<io::Token> tokens;
+  CompletionContext completion;
+  try {
+    Parser p(cmd, bed, &c, &tokens, &completion);
+    p.parse();
+  } catch (const ed_error &e) {
+  }
+  return tokens;
+}
+
 Command Parser::get_command(std::string_view cmd, BEd &bed) {
   Command c;
   std::vector<io::Token> tokens;

src/internal/scripting/ruby.cc

@@ -0,0 +1,149 @@
+#include "internal/scripting/ruby.h"
+#include "bed.h"
+
+namespace bed::internal::scripting {
+static mrb_value mrb_bed_exit(mrb_state *mrb, mrb_value) {
+  mrb_raise(mrb, E_RUNTIME_ERROR, "Use `handle(\"q\")` to quit.");
+  return mrb_nil_value();
+}
+
+static void raise_fatal(mrb_state *mrb, const fatal_error &e) {
+  struct RClass *klass = mrb_class_get(mrb, "FatalError");
+  mrb_value exc = mrb_exc_new_str(mrb, klass, mrb_str_new_cstr(mrb, e.what()));
+  mrb_iv_set(mrb, exc, mrb_intern_lit(mrb, "@code"), mrb_fixnum_value(e.code));
+  mrb_exc_raise(mrb, exc);
+}
+
+static mrb_value mrb_bed_handle(mrb_state *mrb, mrb_value) {
+  auto &ctx = *(BEd *)mrb->ud;
+  const char *command;
+  mrb_int len;
+  mrb_get_args(mrb, "s", &command, &len);
+  std::string_view cmd(command, len);
+  try {
+    ctx.handle(cmd, false);
+  } catch (const ed_error &e) {
+    mrb_raise(mrb, mrb_class_get(mrb, "EdError"), e.what());
+  } catch (const fatal_error &f) {
+    raise_fatal(mrb, f);
+  }
+  return mrb_nil_value();
+}
+
+static mrb_value hash_get(mrb_state *mrb, mrb_value hash, const char *name) {
+  if (mrb_nil_p(hash))
+    return mrb_nil_value();
+  return mrb_hash_get(mrb, hash, mrb_symbol_value(mrb_intern_cstr(mrb, name)));
+}
+
+static functions::Function::AddressKind parse_address_kind(mrb_state *mrb, mrb_value value) {
+  if (mrb_nil_p(value))
+    return functions::Function::AddressKind::None;
+  if (!mrb_symbol_p(value))
+    mrb_raise(mrb, E_TYPE_ERROR, "address must be a Symbol");
+  auto name = mrb_sym_name(mrb, mrb_symbol(value));
+  if (strcmp(name, "none") == 0)
+    return functions::Function::AddressKind::None;
+  if (strcmp(name, "line") == 0)
+    return functions::Function::AddressKind::Line;
+  if (strcmp(name, "range") == 0)
+    return functions::Function::AddressKind::Range;
+  mrb_raisef(mrb, E_ARGUMENT_ERROR, "invalid address type: :%s", name);
+  return functions::Function::AddressKind::None;
+}
+
+static mrb_value mrb_bed_register(mrb_state *mrb, mrb_value) {
+  auto &ctx = *(BEd *)mrb->ud;
+  mrb_sym r_cmd_name;
+  mrb_value proc;
+  mrb_value opts = mrb_nil_value();
+  mrb_get_args(mrb, "n&|H", &r_cmd_name, &proc, &opts);
+  mrb_int cmd_name_len;
+  const char *name = mrb_sym_name_len(mrb, r_cmd_name, &cmd_name_len);
+  std::string_view cmd_name(name, cmd_name_len);
+  std::string desc;
+  mrb_value r_desc = hash_get(mrb, opts, "desc");
+  if (mrb_string_p(r_desc))
+    desc.assign(RSTRING_PTR(r_desc), RSTRING_LEN(r_desc));
+  std::string default_address;
+  mrb_value r_default_address = hash_get(mrb, opts, "default");
+  if (mrb_string_p(r_default_address))
+    default_address.assign(RSTRING_PTR(r_default_address), RSTRING_LEN(r_default_address));
+  ctx.functions.insert(
+    cmd_name,
+    functions::Function{
+      .address_kind = parse_address_kind(mrb, hash_get(mrb, opts, "address")),
+      .argument_kind = functions::Function::ArgumentKind::None,
+      .input_mode = functions::Function::InputMode::None,
+      .desc = desc,
+      .default_address = default_address,
+      .accept_zero = true,
+      .pre_text_mode = nullptr,
+      .handle = [b = Block(mrb, proc)](
+                  BEd &,
+                  const buffer::Address &,
+                  vase::Shard *,
+                  const functions::Function::Argument &,
+                  std::vector<buffer::Line> *
+                ) {
+        b.call();
+      }
+    }
+  );
+  return mrb_nil_value();
+}
+
+static mrb_value mrb_bed_unregister(mrb_state *mrb, mrb_value) {
+  auto &ctx = *(BEd *)mrb->ud;
+  mrb_sym r_cmd_name;
+  mrb_get_args(mrb, "n", &r_cmd_name);
+  mrb_int cmd_name_len;
+  const char *name = mrb_sym_name_len(mrb, r_cmd_name, &cmd_name_len);
+  std::string_view cmd_name(name, cmd_name_len);
+  ctx.functions.remove(cmd_name);
+  return mrb_nil_value();
+}
+
+void register_basic(BEd &ctx) {
+  auto mrb = ctx.mrb.state;
+  auto *bed_error =
+    mrb_define_class(mrb, "EdError", mrb_exc_get_id(mrb, MRB_ERROR_SYM(RuntimeError)));
+  mrb_define_class(mrb, "FatalError", bed_error);
+  mrb_define_method(mrb, mrb->kernel_module, "exit", mrb_bed_exit, MRB_ARGS_NONE());
+  mrb_define_method(mrb, mrb->kernel_module, "handle", mrb_bed_handle, MRB_ARGS_REQ(1));
+  mrb_define_method(mrb, mrb->kernel_module, "register", mrb_bed_register, MRB_ARGS_REQ(1) | MRB_ARGS_OPT(1) | MRB_ARGS_BLOCK());
+  mrb_define_method(mrb, mrb->kernel_module, "unregister", mrb_bed_unregister, MRB_ARGS_REQ(1));
+}
+
+std::string run(BEd &ctx, const std::string &str) {
+  mrb_state *mrb = ctx.mrb.state;
+  mrb_value result = mrb_load_nstring(mrb, str.data(), str.size());
+  if (!mrb->exc) {
+    mrb_value inspected = mrb_funcall(mrb, result, "inspect", 0);
+    std::string output(RSTRING_PTR(inspected), RSTRING_LEN(inspected));
+    return output;
+  }
+  mrb_value exc = mrb_obj_value(mrb->exc);
+  mrb_value msg = mrb_funcall(mrb, exc, "message", 0);
+  std::string error;
+  if (mrb_string_p(msg))
+    error.assign(RSTRING_PTR(msg), RSTRING_LEN(msg));
+  auto *fatal_class = mrb_class_get(mrb, "FatalError");
+  if (mrb_obj_is_kind_of(mrb, exc, fatal_class)) {
+    mrb_value code =
+      mrb_iv_get(mrb, exc, mrb_intern_lit(mrb, "@code"));
+    mrb->exc = nullptr;
+    int c = 1;
+    if (mrb_fixnum_p(code))
+      c = mrb_fixnum(code);
+    throw fatal_error(error, c);
+  }
+  auto *ed_class = mrb_class_get(mrb, "EdError");
+  if (mrb_obj_is_kind_of(mrb, exc, ed_class)) {
+    mrb->exc = nullptr;
+    throw ed_error(error);
+  }
+  mrb->exc = nullptr;
+  throw ed_error("Ruby Exception: " + error);
+}
+} // namespace bed::internal::scripting

src/internal/syntax/iterator.cc

@@ -0,0 +1,48 @@
+#include "internal/syntax/parser.h"
+
+namespace bed::internal::syntax {
+Iterator::Iterator(uint64_t target, ParserSnapshot p, vase::Shard *vase)
+    : snap(p), at(target) {
+  at = target;
+  if (snap.lang)
+    state = ParseState::state_before(*snap.lang, snap.root, vase, at);
+  it = vase::Iterator(vase, at, Direction::Forward);
+}
+
+Iterator::~Iterator() {
+  if (state)
+    snap.lang->destroy(state);
+  release(snap);
+}
+
+Iterator::Iterator(Iterator &&other)
+    : snap(other.snap),
+      it(std::move(other.it)),
+      state(other.state),
+      tokens(std::move(other.tokens)) {
+  other.snap = {};
+  other.state = nullptr;
+}
+
+Iterator &Iterator::operator=(Iterator &&other) {
+  if (this == &other)
+    return *this;
+  if (state)
+    snap.lang->destroy(state);
+  snap = other.snap;
+  it = std::move(other.it);
+  state = other.state;
+  tokens = std::move(other.tokens);
+  other.state = nullptr;
+  return *this;
+}
+
+void Iterator::next() {
+  if (!state)
+    return;
+  it->next();
+  tokens.clear();
+  events.clear();
+  snap.lang->parse(&state, it->line, at++ == 0, &tokens, &events);
+}
+} // namespace bed::internal::syntax

src/internal/syntax/miniparser.cc

@@ -0,0 +1,120 @@
+#include "internal/syntax/miniparser.h"
+
+namespace bed::internal::syntax {
+MiniParser::MiniParser(Language &lang, vase::Shard *vase, void *initial_state)
+    : lang(lang),
+      start_state(initial_state ? lang.copy(initial_state) : lang.none_state()) {
+  vase::Iterator it(vase, 0, Direction::Forward);
+  void *state = lang.copy(start_state);
+  std::vector<io::Token> tokens;
+  std::vector<ParseEvent> events;
+  const uint64_t count = vase ? vase->lines + 1 : 1;
+  lines.reserve(count);
+  for (uint64_t i = 0; i < count; ++i) {
+    it.next();
+    tokens.clear();
+    events.clear();
+    lang.parse(&state, it.line, i == 0, &tokens, &events);
+    lines.emplace_back(lang.copy(state), std::move(tokens));
+  }
+  lang.destroy(state);
+}
+
+MiniParser::~MiniParser() {
+  if (start_state)
+    lang.destroy(start_state);
+  for (auto &[state, tokens] : lines)
+    if (state)
+      lang.destroy(state);
+}
+
+void MiniParser::dirty(vase::Shard *vase, uint64_t start, uint64_t count) {
+  vase::Iterator it(vase, start, Direction::Forward);
+  void *state = start ? lang.copy(lines[start - 1].first)
+                      : lang.copy(start_state);
+  std::vector<ParseEvent> events;
+  uint64_t i = start;
+  for (; i < start + count; i++) {
+    it.next();
+    auto &line = lines[i];
+    line.second.clear();
+    events.clear();
+    lang.parse(&state, it.line, i == 0, &line.second, &events);
+    lang.destroy(line.first);
+    line.first = lang.copy(state);
+  }
+  while (it.next()) {
+    auto &line = lines[i++];
+    line.second.clear();
+    events.clear();
+    lang.parse(&state, it.line, false, &line.second, &events);
+    if (lang.equal(line.first, state))
+      break;
+    lang.destroy(line.first);
+    line.first = lang.copy(state);
+  }
+  lang.destroy(state);
+}
+
+void MiniParser::insert(vase::Shard *vase, uint64_t start, uint64_t count) {
+  vase::Iterator it(vase, start, Direction::Forward);
+  void *state = start ? lang.copy(lines[start - 1].first)
+                      : lang.copy(start_state);
+  std::vector<ParseEvent> events;
+  std::vector<std::pair<void *, std::vector<io::Token>>> lines_new;
+  std::vector<io::Token> tokens;
+  lines_new.reserve(count);
+  for (uint64_t i = 0; i < count; ++i) {
+    it.next();
+    tokens.clear();
+    events.clear();
+    lang.parse(&state, it.line, start + i == 0, &tokens, &events);
+    lines_new.emplace_back(lang.copy(state), std::move(tokens));
+  }
+  uint64_t i = start;
+  while (it.next()) {
+    auto &line = lines[i++];
+    line.second.clear();
+    events.clear();
+    lang.parse(&state, it.line, i == 0, &line.second, &events);
+    if (lang.equal(line.first, state))
+      break;
+    lang.destroy(line.first);
+    line.first = lang.copy(state);
+  }
+  lines.insert(
+    lines.begin() + start,
+    std::make_move_iterator(lines_new.begin()),
+    std::make_move_iterator(lines_new.end())
+  );
+  lang.destroy(state);
+}
+
+void MiniParser::erase(vase::Shard *vase, uint64_t start, uint64_t count) {
+  if (count == 0)
+    return;
+  void *state = start ? lang.copy(lines[start - 1].first)
+                      : lang.copy(start_state);
+  std::vector<ParseEvent> events;
+  for (uint64_t i = start; i < start + count; ++i)
+    if (lines[i].first)
+      lang.destroy(lines[i].first);
+  lines.erase(
+    lines.begin() + start,
+    lines.begin() + start + count
+  );
+  vase::Iterator it(vase, start, Direction::Forward);
+  uint64_t i = start;
+  while (i < lines.size() && it.next()) {
+    auto &line = lines[i];
+    line.second.clear();
+    events.clear();
+    lang.parse(&state, it.line, i++ == 0, &line.second, &events);
+    if (lang.equal(line.first, state))
+      break;
+    lang.destroy(line.first);
+    line.first = lang.copy(state);
+  }
+  lang.destroy(state);
+}
+} // namespace bed::internal::syntax

src/internal/syntax/parser.cc

@@ -1,265 +1,38 @@
 #include "internal/syntax/parser.h"
 
 namespace bed::internal::syntax {
-void dump_events(ParseState *root) {
-  if (!root)
-    return;
-  uint64_t offset = 0;
-  TreeCursor c(root, 0, &offset);
-  uint64_t line_offset = 0;
-  int depth = 0;
-  while (c.leaf) {
-    auto *leaf = c.leaf;
-    for (uint32_t i = 0; i < leaf->n; ++i) {
-      uint32_t block = leaf->blocks[i];
-      uint32_t pos = block & ParseStateLeaf::LINE_MASK;
-      bool closing = block & ParseStateLeaf::IS_CLOSING;
-      if (closing) {
-        if (depth > 0)
-          --depth;
-        else
-          std::cout << "!! UNMATCHED CLOSE !! ";
-      }
-      std::cout << std::string(static_cast<size_t>(depth) * 2, ' ')
-                << (closing ? "}" : "{")
-                << " line " << (line_offset + pos)
-                << '\n';
-      if (!closing)
-        ++depth;
-    }
-    line_offset += leaf->lines();
-    c.next();
-  }
-  if (depth != 0) {
-    std::cout << "!! UNBALANCED: depth = "
-              << depth
-              << " !!\n";
-  }
-}
-
-static void destroy_tree(ParseState *node, Language &lang) {
-  if (!node)
-    return;
-  if (node->is_branch()) {
-    auto *branch = (ParseStateBranch *)node;
-    destroy_tree(branch->left, lang);
-    destroy_tree(branch->right, lang);
-    free(branch);
-  } else {
-    auto *leaf = (ParseStateLeaf *)node;
-    if (leaf->state)
-      lang.destroy(leaf->state);
-    if (leaf->blocks)
-      free(leaf->blocks);
-    free(leaf);
-  }
-}
-
-static ParseState *make_branch(ParseState *left, ParseState *right) {
-  if (!left)
-    return right;
-  if (!right)
-    return left;
-  auto *branch = (ParseStateBranch *)malloc(sizeof(ParseStateBranch));
-  branch->header = ParseState::BRANCH_BIT + left->lines() + right->lines();
-  branch->left = left;
-  branch->right = right;
-  return branch;
-}
-
-static ParseState *build_tree(std::vector<ParseStateLeaf *> &leaves, size_t begin, size_t end) {
-  const size_t count = end - begin;
-  if (count == 0)
-    return nullptr;
-  if (count == 1)
-    return leaves[begin];
-  const size_t mid = begin + count / 2;
-  ParseState *left = build_tree(leaves, begin, mid);
-  ParseState *right = build_tree(leaves, mid, end);
-  return make_branch(left, right);
-}
-
-Parser::Parser(vase::Shard *vase, uint64_t lines, Language lang)
-    : root(nullptr), lang(lang) {
-  reset(vase, lines, lang);
-}
-
-Parser::~Parser() {
-  destroy_tree(root, lang);
-}
-
-void Parser::reset(vase::Shard *vase, uint64_t lines, Language lang_) {
-  destroy_tree(root, lang);
-  root = nullptr;
+ParserSnapshot make_parser(vase::Shard *vase, uint64_t lines, Language *lang) {
+  ParserSnapshot snap{nullptr, lang};
   if (lines == 0)
-    return;
-  lang = std::move(lang_);
-  std::vector<ParseStateLeaf *> leaves;
-  leaves.reserve((lines + MAX_CHUNK - 1) / MAX_CHUNK);
-  uint64_t consumed = 0;
-  while (consumed < lines) {
-    auto *leaf = (ParseStateLeaf *)malloc(sizeof(ParseStateLeaf));
-    leaf->state = nullptr;
-    leaf->blocks = nullptr;
-    leaf->n = 0;
-    leaf->cap = 0;
-    uint64_t chunk = std::min(MAX_CHUNK, lines - consumed);
-    leaf->header = chunk;
-    consumed += chunk;
-    leaves.push_back(leaf);
-  }
-  root = build_tree(leaves, 0, leaves.size());
-  modify(vase, 0, lines);
+    return snap;
+  if (lang)
+    snap.root = ParseState::splice(*lang, nullptr, vase, 0, 0, lines);
+  return snap;
 }
 
-std::pair<ParseState *, ParseState *> Parser::split_tree(ParseState *node, uint64_t line) {
-  if (!node)
-    return {nullptr, nullptr};
-  if (line == 0)
-    return {nullptr, node};
-  if (line >= node->lines())
-    return {node, nullptr};
-  if (node->is_branch()) {
-    auto *branch = (ParseStateBranch *)node;
-    uint64_t left_lines = branch->left->lines();
-    if (line < left_lines) {
-      auto [a, b] = split_tree(branch->left, line);
-      ParseState *right = join_tree(b, branch->right);
-      free(branch);
-      return {a, right};
-    }
-    if (line == left_lines) {
-      ParseState *left = branch->left;
-      ParseState *right = branch->right;
-      free(branch);
-      return {left, right};
-    }
-    auto [a, b] = split_tree(branch->right, line - left_lines);
-    ParseState *left = join_tree(branch->left, a);
-    free(branch);
-    return {left, b};
-  } else {
-    auto *leaf = (ParseStateLeaf *)node;
-    uint64_t lines = leaf->lines();
-    auto *right = (ParseStateLeaf *)malloc(sizeof(ParseStateLeaf));
-    right->header = lines - line;
-    right->state = nullptr;
-    right->blocks = nullptr;
-    right->n = 0;
-    right->cap = 0;
-    leaf->header = line;
-    leaf->n = 0;
-    return {leaf, right};
-  }
+ParserSnapshot retain(const ParserSnapshot &snap) {
+  if (snap.root)
+    ParseState::retain(snap.root);
+  return snap;
 }
 
-ParseState *Parser::join_tree(ParseState *a, ParseState *b) {
-  // TODO: balance
-  return make_branch(a, b);
+void release(ParserSnapshot &snap) {
+  if (snap.root && snap.lang)
+    ParseState::release(*snap.lang, snap.root);
+  snap.root = nullptr;
 }
 
-void Parser::erase(vase::Shard *vase, uint64_t start, uint64_t count) {
-  if (count == 0 || !root)
-    return;
-  auto [a, remaining] = split_tree(root, start);
-  auto [waste, b] = split_tree(remaining, count);
-  destroy_tree(waste, lang);
-  root = join_tree(a, b);
-  modify(vase, start, 1);
+void *state_before(const ParserSnapshot &snap, vase::Shard *vase, uint64_t line) {
+  if (!snap.lang)
+    return nullptr;
+  return ParseState::state_before(*snap.lang, snap.root, vase, line);
 }
 
-void Parser::insert(vase::Shard *vase, uint64_t start, uint64_t count) {
-  if (count == 0)
-    return;
-  std::vector<ParseStateLeaf *> leaves;
-  leaves.reserve((count + MAX_CHUNK - 1) / MAX_CHUNK);
-  uint64_t consumed = 0;
-  while (consumed < count) {
-    auto *leaf = (ParseStateLeaf *)malloc(sizeof(ParseStateLeaf));
-    leaf->state = nullptr;
-    leaf->blocks = nullptr;
-    leaf->n = 0;
-    leaf->cap = 0;
-    uint64_t chunk = std::min(MAX_CHUNK, count - consumed);
-    leaf->header = chunk;
-    consumed += chunk;
-    leaves.push_back(leaf);
-  }
-  ParseState *subtree = build_tree(leaves, 0, leaves.size());
-  auto [left, right] = split_tree(root, start);
-  root = join_tree(join_tree(left, subtree), right);
-  modify(vase, start, count);
-}
-
-void Parser::modify(vase::Shard *vase, uint64_t target, uint64_t count) {
-  if (count == 0 || !root)
-    return;
-  std::vector<Token> tokens;
-  std::vector<ParseEvent> events;
-  uint64_t offset;
-  TreeCursor c = TreeCursor(root, target, &offset);
-  uint64_t at = target - offset;
-  void *state = nullptr;
-  if (c.leaf->state) {
-    state = lang.copy(c.leaf->state);
-  } else {
-    while (!c.leaf->state) {
-      c.prev();
-      if (!c.leaf) {
-        at = 0;
-        break;
-      }
-      at -= c.leaf->lines();
-    }
-    if (c.leaf) {
-      state = lang.copy(c.leaf->state);
-    } else {
-      state = lang.none_state();
-      c = TreeCursor(root, 0, &offset);
-    }
-  }
-  vase::Iterator it(vase, at, Direction::Forward);
-  uint64_t chunk_start = at;
-  uint64_t next_boundary = at + c.leaf->lines();
-  c.leaf->n = 0;
-  while (true) {
-    it.next();
-    if (at == next_boundary) {
-      c.next();
-      if (!c.leaf)
-        break;
-      c.leaf->n = 0;
-      chunk_start = at;
-      next_boundary += c.leaf->lines();
-      if (at >= target + count
-          && c.leaf->state != nullptr
-          && lang.equal(state, c.leaf->state))
-        break;
-      if (c.leaf->state)
-        lang.destroy(c.leaf->state);
-      c.leaf->state = lang.copy(state);
-    }
-    tokens.clear();
-    events.clear();
-    lang.parse(&state, it.line, at == 0, &tokens, &events);
-    for (const auto &ev : events) {
-      if (c.leaf->n == c.leaf->cap) {
-        uint32_t cap = c.leaf->cap ? c.leaf->cap * 2 : 8;
-        c.leaf->blocks = (uint16_t *)realloc(c.leaf->blocks, cap * sizeof(uint16_t));
-        c.leaf->cap = cap;
-      }
-      c.leaf->blocks[c.leaf->n++] = ev.closing << 15 | (at - chunk_start);
-    }
-    at++;
-  }
-  lang.destroy(state);
-}
-
-uint64_t Parser::next_closing(uint64_t line) {
-  if (!root)
-    return UINT64_MAX;
+uint64_t next_closing(const ParserSnapshot &snap, uint64_t line) {
+  if (!snap.root || !snap.lang)
+    return line + 10;
   uint64_t relative = 0;
-  TreeCursor c(root, line, &relative);
+  TreeCursor c(*snap.lang, snap.root, line, &relative);
   uint64_t line_offset = line - relative;
   int level = 0;
   bool first_leaf = true;
@@ -283,14 +56,14 @@ uint64_t Parser::next_closing(uint64_t line) {
     c.next();
     first_leaf = false;
   }
-  return UINT64_MAX;
+  return (snap.root->lines() - line > 10 ? line + 10 : snap.root->lines() - 1);
 }
 
-uint64_t Parser::prev_opening(uint64_t line) {
-  if (!root)
+uint64_t prev_opening(const ParserSnapshot &snap, uint64_t line) {
+  if (!snap.root || !snap.lang)
     return 0;
   uint64_t relative = 0;
-  TreeCursor c(root, line, &relative);
+  TreeCursor c(*snap.lang, snap.root, line, &relative);
   uint64_t line_offset = line - relative;
   int level = 0;
   bool first_leaf = true;
@@ -315,77 +88,66 @@ uint64_t Parser::prev_opening(uint64_t line) {
     if (c.leaf)
       line_offset -= c.leaf->lines();
   }
-  return 0;
+  return (line > 10 ? line - 10 : 0);
 }
 
-std::optional<Parser::Iterator> Parser::get_hl(vase::Shard *vase, uint64_t target) {
-  if (!root)
+std::optional<Iterator> get_hl(const ParserSnapshot &snap, vase::Shard *vase, uint64_t target) {
+  if (!snap.root || !snap.lang)
     return std::nullopt;
-  return Parser::Iterator(target, this, vase);
+  return Iterator(target, retain(snap), vase);
 }
 
-Parser::Iterator::Iterator(uint64_t target, Parser *p, vase::Shard *vase) : p(p) {
-  uint64_t offset;
-  TreeCursor c = TreeCursor(p->root, target, &offset);
-  at = target - offset;
-  if (c.leaf->state) {
-    state = p->lang.copy(c.leaf->state);
+void Edit::mark_dirty(uint64_t start, uint64_t end) {
+  if (!dirty) {
+    dirty_start = start;
+    dirty_end = end;
+    dirty = true;
   } else {
-    while (!c.leaf->state) {
-      c.prev();
-      if (!c.leaf) {
-        at = 0;
-        break;
-      }
-      at -= c.leaf->lines();
-    }
-    if (c.leaf) {
-      state = p->lang.copy(c.leaf->state);
-    } else {
-      state = p->lang.none_state();
-      c = TreeCursor(p->root, 0, &offset);
-    }
-  }
-  it = vase::Iterator(vase, at, Direction::Forward);
-  while (at < target) {
-    it->next();
-    tokens.clear();
-    events.clear();
-    p->lang.parse(&state, it->line, at == 0, &tokens, &events);
-    at++;
+    dirty_start = std::min(dirty_start, start);
+    dirty_end = std::max(dirty_end, end);
   }
 }
 
-Parser::Iterator::~Iterator() {
-  if (state)
-    p->lang.destroy(state);
+void Edit::insert(uint64_t start, uint64_t count) {
+  if (count == 0)
+    return;
+  uint64_t orig_pos = (uint64_t)((int64_t)start - edit_delta);
+  mark_dirty(orig_pos, orig_pos);
+  edit_delta += (int64_t)count;
 }
 
-Parser::Iterator::Iterator(Iterator &&other)
-    : p(other.p),
-      it(std::move(other.it)),
-      state(other.state),
-      tokens(std::move(other.tokens)) {
-  other.state = nullptr;
+void Edit::erase(uint64_t start, uint64_t count) {
+  if (count == 0 || !target->root)
+    return;
+  uint64_t orig_start = (uint64_t)((int64_t)start - edit_delta);
+  uint64_t orig_end = orig_start + count;
+  mark_dirty(orig_start, orig_end);
+  edit_delta -= (int64_t)count;
 }
 
-Parser::Iterator &Parser::Iterator::operator=(Iterator &&other) {
-  if (this == &other)
-    return *this;
-  if (state)
-    p->lang.destroy(state);
-  p = other.p;
-  it = std::move(other.it);
-  state = other.state;
-  tokens = std::move(other.tokens);
-  other.state = nullptr;
-  return *this;
+void Edit::commit(vase::Shard *vase) {
+  if (!dirty || !target->lang)
+    return;
+  uint64_t line = dirty_start;
+  uint64_t original = dirty_end - dirty_start;
+  uint64_t final = (uint64_t)((int64_t)original + edit_delta);
+  ParseState *new_root =
+    ParseState::splice(*target->lang, target->root, vase, line, original, final);
+  release(*target);
+  target->root = new_root;
+  dirty = false;
+  edit_delta = 0;
 }
 
-void Parser::Iterator::next() {
-  it->next();
-  tokens.clear();
-  events.clear();
-  p->lang.parse(&state, it->line, at++ == 0, &tokens, &events);
+void insert(ParserSnapshot &snap, vase::Shard *vase, uint64_t start, uint64_t count) {
+  Edit e(snap);
+  e.insert(start, count);
+  e.commit(vase);
+}
+
+void erase(ParserSnapshot &snap, vase::Shard *vase, uint64_t start, uint64_t count) {
+  Edit e(snap);
+  e.erase(start, count);
+  e.commit(vase);
 }
 } // namespace bed::internal::syntax

src/internal/syntax/parser_state.cc

@@ -0,0 +1,219 @@
+#include "internal/syntax/parser.h"
+
+namespace bed::internal::syntax {
+void ParseState::retain(ParseState *n) {
+  if (n)
+    n->refs++;
+};
+
+void ParseState::release(Language &lang, ParseState *n) {
+  if (!n || --n->refs > 0)
+    return;
+  if (n->is_branch()) {
+    auto *branch = (ParseStateBranch *)n;
+    release(lang, branch->left);
+    release(lang, branch->right);
+    delete branch;
+  } else {
+    auto *leaf = (ParseStateLeaf *)n;
+    if (leaf->state)
+      lang.destroy(leaf->state);
+    if (leaf->blocks)
+      free(leaf->blocks);
+    delete leaf;
+  }
+}
+
+int height(ParseState *n) {
+  return n ? n->height : 0;
+}
+
+int balance_factor(ParseState *n) {
+  ParseStateBranch *b = (ParseStateBranch *)n;
+  return height(b->left) - height(b->right);
+}
+
+ParseState *rotate_right(Language &lang, ParseStateBranch *z) {
+  ParseStateBranch *y = (ParseStateBranch *)z->left;
+  ParseState *middle = new ParseStateBranch(y->right, z->right);
+  ParseState *out = new ParseStateBranch(y->left, middle);
+  ParseState::release(lang, middle);
+  ParseState::release(lang, z);
+  return out;
+}
+
+ParseState *rotate_left(Language &lang, ParseStateBranch *z) {
+  ParseStateBranch *y = (ParseStateBranch *)z->right;
+  ParseState *middle = new ParseStateBranch(z->left, y->left);
+  ParseState *out = new ParseStateBranch(middle, y->right);
+  ParseState::release(lang, middle);
+  ParseState::release(lang, z);
+  return out;
+}
+
+ParseState *balance(Language &lang, ParseState *node) {
+  if (!node || !node->is_branch())
+    return node;
+  ParseStateBranch *b = (ParseStateBranch *)node;
+  int bf = balance_factor(node);
+  if (bf > 1) {
+    ParseStateBranch *left = (ParseStateBranch *)b->left;
+    if (balance_factor(left) < 0) {
+      ParseState::retain(left);
+      auto new_left = rotate_left(lang, left);
+      auto rebuilt = new ParseStateBranch(new_left, b->right);
+      auto result = rotate_right(lang, (ParseStateBranch *)rebuilt);
+      ParseState::release(lang, new_left);
+      ParseState::release(lang, b);
+      return result;
+    }
+    return rotate_right(lang, b);
+  }
+  if (bf < -1) {
+    ParseStateBranch *right = (ParseStateBranch *)b->right;
+    if (balance_factor(right) > 0) {
+      ParseState::retain(right);
+      auto new_right = rotate_right(lang, right);
+      auto rebuilt = new ParseStateBranch(b->left, new_right);
+      auto result = rotate_left(lang, (ParseStateBranch *)rebuilt);
+      ParseState::release(lang, new_right);
+      ParseState::release(lang, b);
+      return result;
+    }
+    return rotate_left(lang, b);
+  }
+  return node;
+}
+
+ParseState *ParseState::build(Language &lang, ParseState **pieces, uint64_t lo, uint64_t hi) {
+  if (hi - lo == 1)
+    return pieces[lo];
+  uint64_t mid = lo + (hi - lo) / 2;
+  ParseState *left = build(lang, pieces, lo, mid);
+  ParseState *right = build(lang, pieces, mid, hi);
+  ParseState *node = concat(lang, left, right);
+  release(lang, left);
+  release(lang, right);
+  return node;
+}
+
+ParseState *ParseState::splice(
+  Language &lang, ParseState *root, vase::Shard *vase,
+  uint64_t line, uint64_t original, uint64_t final
+) {
+  if (!vase)
+    return nullptr;
+  if (!root || (line == 0 && root->lines() == original)) {
+    vase::Iterator it(vase, 0, Direction::Forward);
+    void *state = lang.none_state();
+    std::vector<io::Token> tokens;
+    std::vector<ParseEvent> events;
+    ParsePieceBuilder builder(lang, 0, state);
+    for (uint64_t at = 0; at < final; ++at) {
+      it.next();
+      tokens.clear();
+      events.clear();
+      lang.parse(&state, it.line, at == 0, &tokens, &events);
+      builder.add(state, at, events);
+    }
+    lang.destroy(state);
+    return builder.finish();
+  }
+  uint64_t at;
+  void *state;
+  ParseState *prefix;
+  {
+    uint64_t offset;
+    TreeCursor c = TreeCursor(lang, root, line, &offset);
+    prefix = c.prefix();
+    at = line - offset;
+    state = lang.copy(c.leaf->state);
+  }
+  vase::Iterator it(vase, at, Direction::Forward);
+  std::vector<io::Token> tokens;
+  std::vector<ParseEvent> events;
+  uint64_t end_in_tree = line + original;
+  uint64_t end_extra;
+  TreeCursor c = TreeCursor(lang, root, end_in_tree, &end_extra);
+  uint64_t end_in_vase = line + final;
+  ParsePieceBuilder builder(lang, at, state);
+  while (at < end_in_vase + end_extra) {
+    it.next();
+    tokens.clear();
+    events.clear();
+    lang.parse(&state, it.line, at == 0, &tokens, &events);
+    builder.add(state, at, events);
+    ++at;
+  }
+  c.next();
+  while (c.leaf) {
+    if (lang.equal(state, c.leaf->state))
+      break;
+    for (uint64_t i = 0; i < c.leaf->lines(); ++i) {
+      it.next();
+      tokens.clear();
+      events.clear();
+      lang.parse(&state, it.line, at == 0, &tokens, &events);
+      builder.add(state, at, events);
+      ++at;
+    }
+    c.next();
+  }
+  lang.destroy(state);
+  ParseState *suffix = c.suffix();
+  ParseState *new_stuff = builder.finish();
+  auto a = concat(lang, prefix, new_stuff);
+  release(lang, prefix);
+  release(lang, new_stuff);
+  auto result = concat(lang, a, suffix);
+  release(lang, a);
+  release(lang, suffix);
+  return result;
+}
+
+ParseState *ParseState::concat(Language &lang, ParseState *a, ParseState *b) {
+  if (!a)
+    return (retain(b), b);
+  if (!b)
+    return (retain(a), a);
+  if (a->height > b->height + 1) {
+    ParseStateBranch *ba = (ParseStateBranch *)a;
+    ParseState *r = concat(lang, ba->right, b);
+    ParseState *out = balance(lang, new ParseStateBranch(ba->left, r));
+    release(lang, r);
+    return out;
+  }
+  if (b->height > a->height + 1) {
+    ParseStateBranch *bb = (ParseStateBranch *)b;
+    ParseState *l = concat(lang, a, bb->left);
+    ParseState *out = balance(lang, new ParseStateBranch(l, bb->right));
+    release(lang, l);
+    return out;
+  }
+  return balance(lang, new ParseStateBranch(a, b));
+}
+
+void *ParseState::state_before(Language &lang, ParseState *root, vase::Shard *vase, uint64_t line) {
+  uint64_t offset;
+  uint64_t at;
+  void *state;
+  if (!root) {
+    at = 0;
+    state = lang.none_state();
+  } else {
+    TreeCursor c = TreeCursor(lang, root, line, &offset);
+    at = line - offset;
+    state = lang.copy(c.leaf->state);
+  }
+  vase::Iterator it(vase, at, Direction::Forward);
+  std::vector<io::Token> tokens;
+  std::vector<ParseEvent> events;
+  for (; at < line; ++at) {
+    it.next();
+    tokens.clear();
+    events.clear();
+    lang.parse(&state, it.line, at == 0, &tokens, &events);
+  }
+  return state;
+}
+} // namespace bed::internal::syntax

src/internal/syntax/ruby/parse.cc

@@ -34,12 +34,26 @@ inline uint8_t utf8_codepoint_width(unsigned char c) {
   return 1;
 }
 
-bool handle_escapes(RubyParser &p, std::vector<Token> *tokens, uint32_t &start, bool string = true) {
-  if (p.peek() == '\\') {
+bool handle_escapes(RubyParser &p, std::vector<io::Token> *tokens, uint32_t &start, bool string = true) {
+  if (p.peek() != '\\')
+    return false;
+  if (!(p.current().flags & RubyState::RubyInternalState::ALLOW_ESCAPE)) {
+    p.advance();
+    if (p.peek() != '\'' && p.peek() != '\\')
+      return false;
     if (string)
-      tokens->push_back({start, p.i, Token::String});
+      tokens->push_back({start, p.i - 1, io::Token::String});
     else
-      tokens->push_back({start, p.i, Token::Regexp});
+      tokens->push_back({start, p.i - 1, io::Token::Regexp});
+    p.advance();
+    tokens->push_back({p.i - 2, p.i, io::Token::Escape});
+    start = p.i;
+    return true;
+  }
+  if (string)
+    tokens->push_back({start, p.i, io::Token::String});
+  else
+    tokens->push_back({start, p.i, io::Token::Regexp});
   start = p.i;
   p.advance();
   if (p.peek() == 'x') {
@@ -95,14 +109,12 @@ bool handle_escapes(RubyParser &p, std::vector<Token> *tokens, uint32_t &start,
   } else {
     p.advance();
   }
-    tokens->push_back({start, p.i, Token::Escape});
+  tokens->push_back({start, p.i, io::Token::Escape});
   start = p.i;
   return true;
-  }
-  return false;
 };
 
-bool handle_heredoc(RubyParser &p, std::vector<Token> *tokens) {
+bool handle_heredoc(RubyParser &p, std::vector<io::Token> *tokens, std::vector<ParseEvent> *events) {
   uint8_t *heredocs = p.state->heredocs();
   uint32_t start = p.i;
   if (start == 0) {
@@ -114,21 +126,22 @@ bool handle_heredoc(RubyParser &p, std::vector<Token> *tokens) {
         && memcmp(p.line.data() + start, heredocs + 1, heredoc_len) == 0) {
       if (!p.dequeue_doc(heredoc_len))
         p.current().state = RubyState::RubyInternalState::NONE;
-      tokens->push_back({p.i, p.len(), Token::Annotation});
+      events->push_back(true);
+      tokens->push_back({p.i, p.len(), io::Token::Annotation});
       p.current().flags |= RubyState::RubyInternalState::EXPECTING_EXPRESSION;
       return true;
     }
   }
   if (!(heredocs[0] & RubyState::Heredocs::ALLOW_INTERPOLATION)) {
-    tokens->push_back({p.i, p.len(), Token::String});
+    tokens->push_back({p.i, p.len(), io::Token::String});
     return true;
   } else {
     while (p.i < p.len()) {
       if (handle_escapes(p, tokens, start))
         continue;
       if (p.peek_str(2) == "#{") {
-        tokens->push_back({start, p.i, Token::String});
-        tokens->push_back({p.i, p.i + 2, Token::Interpolation});
+        tokens->push_back({start, p.i, io::Token::String});
+        tokens->push_back({p.i, p.i + 2, io::Token::Interpolation});
         p.advance(2);
         p.push_state();
         return false;
@@ -136,20 +149,20 @@ bool handle_heredoc(RubyParser &p, std::vector<Token> *tokens) {
       p.advance();
     }
     if (p.i >= p.len())
-      tokens->push_back({start, p.len(), Token::String});
+      tokens->push_back({start, p.len(), io::Token::String});
     return true;
   }
 }
 
-void handle_string(RubyParser &p, std::vector<Token> *tokens) {
+void handle_string(RubyParser &p, std::vector<io::Token> *tokens) {
   uint32_t start = p.i;
   while (p.i < p.len()) {
     if (handle_escapes(p, tokens, start))
       continue;
     if ((p.current().flags & RubyState::RubyInternalState::ALLOW_INTERPOLATION)
         && p.peek_str(2) == "#{") {
-      tokens->push_back({start, p.i, Token::String});
-      tokens->push_back({p.i, p.i + 2, Token::Interpolation});
+      tokens->push_back({start, p.i, io::Token::String});
+      tokens->push_back({p.i, p.i + 2, io::Token::Interpolation});
       p.advance(2);
       p.push_state();
       return;
@@ -160,7 +173,7 @@ void handle_string(RubyParser &p, std::vector<Token> *tokens) {
     if (p.peek() == p.current().delim_end) {
       if (p.current().delim_start == p.current().delim_end) {
         p.advance();
-        tokens->push_back({start, p.i, Token::String});
+        tokens->push_back({start, p.i, io::Token::String});
         p.current().state = RubyState::RubyInternalState::NONE;
         p.current().flags &= ~RubyState::RubyInternalState::EXPECTING_EXPRESSION;
         return;
@@ -168,7 +181,7 @@ void handle_string(RubyParser &p, std::vector<Token> *tokens) {
         p.current().lit_brace_level--;
         if (p.current().lit_brace_level == 0) {
           p.advance();
-          tokens->push_back({start, p.i, Token::String});
+          tokens->push_back({start, p.i, io::Token::String});
           p.current().state = RubyState::RubyInternalState::NONE;
           p.current().flags &= ~RubyState::RubyInternalState::EXPECTING_EXPRESSION;
           return;
@@ -178,18 +191,18 @@ void handle_string(RubyParser &p, std::vector<Token> *tokens) {
     p.advance();
   }
   if (p.i >= p.len())
-    tokens->push_back({start, p.len(), Token::String});
+    tokens->push_back({start, p.len(), io::Token::String});
 }
 
-void handle_regex(RubyParser &p, std::vector<Token> *tokens) {
+void handle_regex(RubyParser &p, std::vector<io::Token> *tokens) {
   uint32_t start = p.i;
   while (p.i < p.len()) {
     if (handle_escapes(p, tokens, start, false))
       continue;
     if ((p.current().flags & RubyState::RubyInternalState::ALLOW_INTERPOLATION)
         && p.peek_str(2) == "#{") {
-      tokens->push_back({start, p.i, Token::Regexp});
-      tokens->push_back({p.i, p.i + 2, Token::Interpolation});
+      tokens->push_back({start, p.i, io::Token::Regexp});
+      tokens->push_back({p.i, p.i + 2, io::Token::Interpolation});
       p.advance(2);
       p.push_state();
       return;
@@ -200,7 +213,7 @@ void handle_regex(RubyParser &p, std::vector<Token> *tokens) {
     if (p.peek() == p.current().delim_end) {
       if (p.current().delim_start == p.current().delim_end) {
         p.advance();
-        tokens->push_back({start, p.i, Token::Regexp});
+        tokens->push_back({start, p.i, io::Token::Regexp});
         p.current().state = RubyState::RubyInternalState::NONE;
         p.current().flags &= ~RubyState::RubyInternalState::EXPECTING_EXPRESSION;
         return;
@@ -208,7 +221,7 @@ void handle_regex(RubyParser &p, std::vector<Token> *tokens) {
         p.current().lit_brace_level--;
         if (p.current().lit_brace_level == 0) {
           p.advance();
-          tokens->push_back({start, p.i, Token::Regexp});
+          tokens->push_back({start, p.i, io::Token::Regexp});
           p.current().state = RubyState::RubyInternalState::NONE;
           p.current().flags &= ~RubyState::RubyInternalState::EXPECTING_EXPRESSION;
           return;
@@ -218,15 +231,15 @@ void handle_regex(RubyParser &p, std::vector<Token> *tokens) {
     p.advance();
   }
   if (p.i >= p.len())
-    tokens->push_back({start, p.len(), Token::Regexp});
+    tokens->push_back({start, p.len(), io::Token::Regexp});
 }
 
-bool handle_line_markers(RubyParser &p, std::vector<Token> *tokens, std::vector<ParseEvent> *events) {
+bool handle_line_markers(RubyParser &p, std::vector<io::Token> *tokens, std::vector<ParseEvent> *events) {
   if (p.len() == 6 && p.peek_str(6) == "=begin") {
     p.current().state = RubyState::RubyInternalState::COMMENT;
     p.current().flags &= ~RubyState::RubyInternalState::EXPECTING_EXPRESSION;
     events->push_back(false);
-    tokens->push_back({0, p.len(), Token::Comment});
+    tokens->push_back({0, p.len(), io::Token::Comment});
     return true;
   }
   if (p.len() == 7 && p.peek_str(7) == "__END__") {
@@ -237,20 +250,20 @@ bool handle_line_markers(RubyParser &p, std::vector<Token> *tokens, std::vector<
   return false;
 }
 
-bool handle_comment(RubyParser &p, std::vector<Token> *tokens, bool first_line) {
+bool handle_comment(RubyParser &p, std::vector<io::Token> *tokens, bool first_line) {
   if (p.peek() == '#') {
     p.current().flags &= ~RubyState::RubyInternalState::EXPECTING_EXPRESSION;
     if (first_line && p.i == 0 && p.peek(1) == '!') {
-      tokens->push_back({0, p.len(), Token::Shebang});
+      tokens->push_back({0, p.len(), io::Token::Shebang});
       return true;
     }
-    tokens->push_back({p.i, p.len(), Token::Comment});
+    tokens->push_back({p.i, p.len(), io::Token::Comment});
     return true;
   }
   return false;
 }
 
-bool handle_syntax(RubyParser &p, std::vector<Token> *tokens, std::vector<ParseEvent> *events) {
+bool handle_syntax(RubyParser &p, std::vector<io::Token> *tokens, std::vector<ParseEvent> *events) {
   static const RubyTries tries = RubyTries();
   if (p.peek() == ' ' || p.peek() == '\t') {
     while (p.peek() == ' ' || p.peek() == '\t')
@@ -276,7 +289,7 @@ bool handle_syntax(RubyParser &p, std::vector<Token> *tokens, std::vector<ParseE
         j++;
         while (identifier_char(p.peek(j)))
           j++;
-        tokens->push_back({p.i, p.i + j, Token::Constant});
+        tokens->push_back({p.i, p.i + j, io::Token::Constant});
         p.advance(j);
         while (p.peek() == ' ' || p.peek() == '\t')
           p.advance();
@@ -298,11 +311,11 @@ bool handle_syntax(RubyParser &p, std::vector<Token> *tokens, std::vector<ParseE
         if (p.peek(j) == '!' || p.peek(j) == '?')
           j++;
         if ('A' <= p.peek() && p.peek() <= 'Z')
-          tokens->push_back({p.i, p.i + j, Token::Constant});
+          tokens->push_back({p.i, p.i + j, io::Token::Constant});
         else if (j == 4 && p.peek_str(4) == "self")
-          tokens->push_back({p.i, p.i + j, Token::Keyword});
+          tokens->push_back({p.i, p.i + j, io::Token::Keyword});
         else
-          tokens->push_back({p.i, p.i + j, Token::Function});
+          tokens->push_back({p.i, p.i + j, io::Token::Function});
         p.advance(j);
         while (p.peek() == ' ' || p.peek() == '\t')
           p.advance();
@@ -321,7 +334,7 @@ bool handle_syntax(RubyParser &p, std::vector<Token> *tokens, std::vector<ParseE
         j++;
         while (identifier_char(p.peek(j)))
           j++;
-        tokens->push_back({p.i, p.i + j, Token::Constant});
+        tokens->push_back({p.i, p.i + j, io::Token::Constant});
         p.advance(j);
         while (p.peek() == ' ' || p.peek() == '\t')
           p.advance();
@@ -343,7 +356,7 @@ bool handle_syntax(RubyParser &p, std::vector<Token> *tokens, std::vector<ParseE
       indented = true;
     if (p.peek(j) == '~' || p.peek(j) == '-')
       j++;
-    tokens->push_back({p.i, p.i + j, Token::Operator});
+    tokens->push_back({p.i, p.i + j, io::Token::Operator});
     if (p.i + j >= p.len())
       return false;
     std::string delim;
@@ -366,7 +379,8 @@ bool handle_syntax(RubyParser &p, std::vector<Token> *tokens, std::vector<ParseE
       return false;
     p.current().flags &= ~RubyState::RubyInternalState::EXPECTING_EXPRESSION;
     if (!delim.empty()) {
-      tokens->push_back({s, p.i + j, Token::Annotation});
+      events->push_back(false);
+      tokens->push_back({s, p.i + j, io::Token::Annotation});
       uint8_t header = delim.size();
       if (interpolation)
         header |= RubyState::Heredocs::ALLOW_INTERPOLATION;
@@ -380,7 +394,7 @@ bool handle_syntax(RubyParser &p, std::vector<Token> *tokens, std::vector<ParseE
     return false;
   }
   if (p.peek() == '/' && p.current().flags & RubyState::RubyInternalState::EXPECTING_EXPRESSION) {
-    tokens->push_back({p.i, p.i + 1, Token::Regexp});
+    tokens->push_back({p.i, p.i + 1, io::Token::Regexp});
     p.current().state = RubyState::RubyInternalState::REGEXP;
     p.current().flags &= ~RubyState::RubyInternalState::EXPECTING_EXPRESSION;
     p.current().flags |= RubyState::RubyInternalState::ALLOW_INTERPOLATION;
@@ -399,7 +413,7 @@ bool handle_syntax(RubyParser &p, std::vector<Token> *tokens, std::vector<ParseE
       if (p.peek() == '.')
         p.advance();
     }
-    tokens->push_back({start, p.i, Token::Operator});
+    tokens->push_back({start, p.i, io::Token::Operator});
     return false;
   }
   case ':': {
@@ -407,17 +421,17 @@ bool handle_syntax(RubyParser &p, std::vector<Token> *tokens, std::vector<ParseE
     uint32_t start = p.i;
     p.advance();
     if (p.i >= p.len()) {
-      tokens->push_back({start, p.i, Token::Operator});
+      tokens->push_back({start, p.i, io::Token::Operator});
       p.current().flags |= RubyState::RubyInternalState::EXPECTING_EXPRESSION;
       return false;
     }
     if (p.peek() == ':') {
       p.advance();
-      tokens->push_back({start, p.i, Token::Operator});
+      tokens->push_back({start, p.i, io::Token::Operator});
       return false;
     }
     if (p.peek() == '\'' || p.peek() == '"') {
-      tokens->push_back({start, p.i, Token::Label});
+      tokens->push_back({start, p.i, io::Token::Label});
       p.current().flags |= RubyState::RubyInternalState::EXPECTING_EXPRESSION;
       return false;
     }
@@ -428,12 +442,12 @@ bool handle_syntax(RubyParser &p, std::vector<Token> *tokens, std::vector<ParseE
         p.advance();
       while (identifier_char(p.peek()))
         p.advance();
-      tokens->push_back({start, p.i, Token::Label});
+      tokens->push_back({start, p.i, io::Token::Label});
       return false;
     }
     uint32_t op_len = tries.operator_trie.longest_match(p.peek_str(p.len() - p.i));
     if (op_len > 0) {
-      tokens->push_back({start, p.i + op_len, Token::Label});
+      tokens->push_back({start, p.i + op_len, io::Token::Label});
       p.advance(op_len);
       return false;
     }
@@ -443,10 +457,10 @@ bool handle_syntax(RubyParser &p, std::vector<Token> *tokens, std::vector<ParseE
         p.advance();
       if (p.peek() == '!' || p.peek() == '?')
         p.advance();
-      tokens->push_back({start, p.i, Token::Label});
+      tokens->push_back({start, p.i, io::Token::Label});
       return false;
     }
-    tokens->push_back({start, p.i, Token::Operator});
+    tokens->push_back({start, p.i, io::Token::Operator});
     return false;
   }
   case '@': {
@@ -463,7 +477,7 @@ bool handle_syntax(RubyParser &p, std::vector<Token> *tokens, std::vector<ParseE
       return false;
     while (identifier_char(p.peek()))
       p.advance();
-    tokens->push_back({start, p.i, Token::VariableInstance});
+    tokens->push_back({start, p.i, io::Token::VariableInstance});
     return false;
   }
   case '$': {
@@ -510,7 +524,7 @@ bool handle_syntax(RubyParser &p, std::vector<Token> *tokens, std::vector<ParseE
         return false;
       }
     }
-    tokens->push_back({start, p.i, Token::VariableGlobal});
+    tokens->push_back({start, p.i, io::Token::VariableGlobal});
     return false;
   }
   case '?': {
@@ -526,7 +540,7 @@ bool handle_syntax(RubyParser &p, std::vector<Token> *tokens, std::vector<ParseE
           p.advance();
         if (is_hex(p.peek()))
           p.advance();
-        tokens->push_back({start, p.i, Token::Char});
+        tokens->push_back({start, p.i, io::Token::Char});
         return false;
       } else if (p.peek() == 'u') {
         p.advance();
@@ -546,7 +560,7 @@ bool handle_syntax(RubyParser &p, std::vector<Token> *tokens, std::vector<ParseE
           if (is_hex(p.peek()))
             p.advance();
         }
-        tokens->push_back({start, p.i, Token::Char});
+        tokens->push_back({start, p.i, io::Token::Char});
         return false;
       } else if ('0' <= p.peek() && p.peek() <= '7') {
         p.advance();
@@ -554,7 +568,7 @@ bool handle_syntax(RubyParser &p, std::vector<Token> *tokens, std::vector<ParseE
           p.advance();
         if ('0' <= p.peek() && p.peek() <= '7')
           p.advance();
-        tokens->push_back({start, p.i, Token::Char});
+        tokens->push_back({start, p.i, io::Token::Char});
         return false;
       } else if (p.peek() == 'c') {
         p.advance();
@@ -562,7 +576,7 @@ bool handle_syntax(RubyParser &p, std::vector<Token> *tokens, std::vector<ParseE
           p.advance();
         else
           goto combination;
-        tokens->push_back({start, p.i, Token::Char});
+        tokens->push_back({start, p.i, io::Token::Char});
         return false;
       } else if (p.peek() == 'M' || p.peek() == 'C') {
         p.advance();
@@ -573,7 +587,7 @@ bool handle_syntax(RubyParser &p, std::vector<Token> *tokens, std::vector<ParseE
           else
             goto combination;
         }
-        tokens->push_back({start, p.i, Token::Char});
+        tokens->push_back({start, p.i, io::Token::Char});
         return false;
       } else if (p.peek() == 'N') {
         p.advance();
@@ -584,28 +598,28 @@ bool handle_syntax(RubyParser &p, std::vector<Token> *tokens, std::vector<ParseE
           if (p.peek() == '}')
             p.advance();
         }
-        tokens->push_back({start, p.i, Token::Char});
+        tokens->push_back({start, p.i, io::Token::Char});
         return false;
       } else {
         p.advance();
-        tokens->push_back({start, p.i, Token::Char});
+        tokens->push_back({start, p.i, io::Token::Char});
         return false;
       }
     } else if (p.peek() != '\0' && p.peek() != ' ' && p.peek() != '\t') {
       p.advance();
-      tokens->push_back({start, p.i, Token::Char});
+      tokens->push_back({start, p.i, io::Token::Char});
       return false;
     } else {
       p.current().flags &= ~RubyState::RubyInternalState::EXPECTING_EXPRESSION;
-      tokens->push_back({start, p.i, Token::Operator});
+      tokens->push_back({start, p.i, io::Token::Operator});
       return false;
     }
   }
   case '{': {
     p.current().flags |= RubyState::RubyInternalState::EXPECTING_EXPRESSION;
     uint8_t brace_color =
-      (uint8_t)Token::Brace1 + (p.current().brace_level % 5);
-    tokens->push_back({p.i, p.i + 1, (Token::Kind)brace_color});
+      (uint8_t)io::Token::Brace1 + (p.current().brace_level % 5);
+    tokens->push_back({p.i, p.i + 1, (io::Token::Kind)brace_color});
     p.current().brace_level++;
     p.advance();
     return false;
@@ -614,11 +628,11 @@ bool handle_syntax(RubyParser &p, std::vector<Token> *tokens, std::vector<ParseE
     p.current().flags &= ~RubyState::RubyInternalState::EXPECTING_EXPRESSION;
     if (!--p.current().brace_level && p.state->top > 1) {
       p.pop_state();
-      tokens->push_back({p.i, p.i + 1, Token::Interpolation});
+      tokens->push_back({p.i, p.i + 1, io::Token::Interpolation});
     } else {
       uint8_t brace_color =
-        (uint8_t)Token::Brace1 + (p.current().brace_level % 5);
-      tokens->push_back({p.i, p.i + 1, (Token::Kind)brace_color});
+        (uint8_t)io::Token::Brace1 + (p.current().brace_level % 5);
+      tokens->push_back({p.i, p.i + 1, (io::Token::Kind)brace_color});
     }
     p.advance();
     return false;
@@ -626,8 +640,8 @@ bool handle_syntax(RubyParser &p, std::vector<Token> *tokens, std::vector<ParseE
   case '(': {
     p.current().flags |= RubyState::RubyInternalState::EXPECTING_EXPRESSION;
     uint8_t brace_color =
-      (uint8_t)Token::Brace1 + (p.current().brace_level % 5);
-    tokens->push_back({p.i, p.i + 1, (Token::Kind)brace_color});
+      (uint8_t)io::Token::Brace1 + (p.current().brace_level % 5);
+    tokens->push_back({p.i, p.i + 1, (io::Token::Kind)brace_color});
     p.current().brace_level++;
     p.advance();
     return false;
@@ -636,16 +650,16 @@ bool handle_syntax(RubyParser &p, std::vector<Token> *tokens, std::vector<ParseE
     p.current().flags &= ~RubyState::RubyInternalState::EXPECTING_EXPRESSION;
     p.current().brace_level--;
     uint8_t brace_color =
-      (uint8_t)Token::Brace1 + (p.current().brace_level % 5);
-    tokens->push_back({p.i, p.i + 1, (Token::Kind)brace_color});
+      (uint8_t)io::Token::Brace1 + (p.current().brace_level % 5);
+    tokens->push_back({p.i, p.i + 1, (io::Token::Kind)brace_color});
     p.advance();
     return false;
   }
   case '[': {
     p.current().flags |= RubyState::RubyInternalState::EXPECTING_EXPRESSION;
     uint8_t brace_color =
-      (uint8_t)Token::Brace1 + (p.current().brace_level % 5);
-    tokens->push_back({p.i, p.i + 1, (Token::Kind)brace_color});
+      (uint8_t)io::Token::Brace1 + (p.current().brace_level % 5);
+    tokens->push_back({p.i, p.i + 1, (io::Token::Kind)brace_color});
     p.current().brace_level++;
     p.advance();
     return false;
@@ -654,34 +668,36 @@ bool handle_syntax(RubyParser &p, std::vector<Token> *tokens, std::vector<ParseE
     p.current().flags &= ~RubyState::RubyInternalState::EXPECTING_EXPRESSION;
     p.current().brace_level--;
     uint8_t brace_color =
-      (uint8_t)Token::Brace1 + (p.current().brace_level % 5);
-    tokens->push_back({p.i, p.i + 1, (Token::Kind)brace_color});
+      (uint8_t)io::Token::Brace1 + (p.current().brace_level % 5);
+    tokens->push_back({p.i, p.i + 1, (io::Token::Kind)brace_color});
     p.advance();
     return false;
   }
   case '\'': {
     p.current().flags &= ~RubyState::RubyInternalState::EXPECTING_EXPRESSION;
-    tokens->push_back({p.i, p.i + 1, Token::String});
+    tokens->push_back({p.i, p.i + 1, io::Token::String});
     p.current().state = RubyState::RubyInternalState::STRING;
     p.current().delim_start = '\'';
     p.current().delim_end = '\'';
     p.current().flags &= ~RubyState::RubyInternalState::ALLOW_INTERPOLATION;
+    p.current().flags &= ~RubyState::RubyInternalState::ALLOW_ESCAPE;
     p.advance();
     return false;
   }
   case '"': {
     p.current().flags &= ~RubyState::RubyInternalState::EXPECTING_EXPRESSION;
-    tokens->push_back({p.i, p.i + 1, Token::String});
+    tokens->push_back({p.i, p.i + 1, io::Token::String});
     p.current().state = RubyState::RubyInternalState::STRING;
     p.current().delim_start = '"';
     p.current().delim_end = '"';
     p.current().flags |= RubyState::RubyInternalState::ALLOW_INTERPOLATION;
+    p.current().flags |= RubyState::RubyInternalState::ALLOW_ESCAPE;
     p.advance();
     return false;
   }
   case '`': {
     p.current().flags &= ~RubyState::RubyInternalState::EXPECTING_EXPRESSION;
-    tokens->push_back({p.i, p.i + 1, Token::String});
+    tokens->push_back({p.i, p.i + 1, io::Token::String});
     p.current().state = RubyState::RubyInternalState::STRING;
     p.current().delim_start = '`';
     p.current().delim_end = '`';
@@ -691,7 +707,7 @@ bool handle_syntax(RubyParser &p, std::vector<Token> *tokens, std::vector<ParseE
   }
   case '%': {
     if (p.i + 1 >= p.len()) {
-      tokens->push_back({p.i, p.i + 1, Token::Operator});
+      tokens->push_back({p.i, p.i + 1, io::Token::Operator});
       p.advance();
       p.current().flags |= RubyState::RubyInternalState::EXPECTING_EXPRESSION;
       return false;
@@ -701,6 +717,7 @@ bool handle_syntax(RubyParser &p, std::vector<Token> *tokens, std::vector<ParseE
     char delim_start = '\0';
     char delim_end = '\0';
     bool allow_interp = true;
+    bool allow_escape = true;
     int prefix_len = 1;
     bool is_regexp = false;
     switch (type) {
@@ -714,6 +731,7 @@ bool handle_syntax(RubyParser &p, std::vector<Token> *tokens, std::vector<ParseE
     case 'I':
     case 'W':
       allow_interp = true;
+      allow_escape = true;
       prefix_len = 2;
       break;
     case 'w':
@@ -721,22 +739,24 @@ bool handle_syntax(RubyParser &p, std::vector<Token> *tokens, std::vector<ParseE
     case 'i':
     case 's':
       allow_interp = false;
+      allow_escape = false;
       prefix_len = 2;
       break;
     default:
       allow_interp = true;
+      allow_escape = true;
       prefix_len = 1;
       break;
     }
     if (p.i + prefix_len >= p.len()) {
-      tokens->push_back({p.i, p.i + 1, Token::Operator});
+      tokens->push_back({p.i, p.i + 1, io::Token::Operator});
       p.advance(prefix_len);
       p.current().flags |= RubyState::RubyInternalState::EXPECTING_EXPRESSION;
       return false;
     }
     delim_start = p.peek(prefix_len);
     if (identifier_char(delim_start) || delim_start == ' ') {
-      tokens->push_back({p.i, p.i + 1, Token::Operator});
+      tokens->push_back({p.i, p.i + 1, io::Token::Operator});
       p.advance(prefix_len);
       p.current().flags |= RubyState::RubyInternalState::EXPECTING_EXPRESSION;
       return false;
@@ -758,7 +778,7 @@ bool handle_syntax(RubyParser &p, std::vector<Token> *tokens, std::vector<ParseE
       delim_end = delim_start;
       break;
     }
-    tokens->push_back({p.i, p.i + prefix_len + 1, (is_regexp ? Token::Regexp : Token::String)});
+    tokens->push_back({p.i, p.i + prefix_len + 1, (is_regexp ? io::Token::Regexp : io::Token::String)});
     p.current().state = is_regexp
                           ? RubyState::RubyInternalState::REGEXP
                           : RubyState::RubyInternalState::STRING;
@@ -766,6 +786,8 @@ bool handle_syntax(RubyParser &p, std::vector<Token> *tokens, std::vector<ParseE
     p.current().delim_end = delim_end;
     if (allow_interp)
       p.current().flags |= RubyState::RubyInternalState::ALLOW_INTERPOLATION;
+    if (allow_escape)
+      p.current().flags |= RubyState::RubyInternalState::ALLOW_ESCAPE;
     p.current().lit_brace_level = 1;
     p.advance(prefix_len + 1);
     return false;
@@ -780,11 +802,6 @@ bool handle_syntax(RubyParser &p, std::vector<Token> *tokens, std::vector<ParseE
       p.ending = false;
     p.advance();
     return false;
-  case '\0':
-    if (p.ending)
-      p.current().flags |= RubyState::RubyInternalState::EXPECTING_EXPRESSION;
-    p.advance();
-    return false;
   default:
     if ('0' <= p.peek() && p.peek() <= '9') {
       p.current().flags &= ~RubyState::RubyInternalState::EXPECTING_EXPRESSION;
@@ -860,7 +877,7 @@ bool handle_syntax(RubyParser &p, std::vector<Token> *tokens, std::vector<ParseE
           }
         }
       }
-      tokens->push_back({start, p.i, Token::Number});
+      tokens->push_back({start, p.i, io::Token::Number});
       return false;
     } else if (identifier_start_char(p.peek())) {
       uint32_t j = 1;
@@ -870,93 +887,93 @@ bool handle_syntax(RubyParser &p, std::vector<Token> *tokens, std::vector<ParseE
         j++;
       if (j == tries.base_keywords_trie.longest_match(p.peek_str(j))) {
         p.current().flags &= ~RubyState::RubyInternalState::EXPECTING_EXPRESSION;
-        tokens->push_back({p.i, p.i + j, Token::Keyword});
+        tokens->push_back({p.i, p.i + j, io::Token::Keyword});
         p.advance(j);
         return false;
       } else if (j == tries.expecting_keywords_trie.longest_match(p.peek_str(j))) {
         p.current().flags |= RubyState::RubyInternalState::EXPECTING_EXPRESSION;
-        tokens->push_back({p.i, p.i + j, Token::Keyword});
+        tokens->push_back({p.i, p.i + j, io::Token::Keyword});
         p.advance(j);
         return false;
       } else if (j == tries.operator_keywords_trie.longest_match(p.peek_str(j))) {
         p.current().flags &= ~RubyState::RubyInternalState::EXPECTING_EXPRESSION;
-        tokens->push_back({p.i, p.i + j, Token::KeywordOperator});
+        tokens->push_back({p.i, p.i + j, io::Token::KeywordOperator});
         p.advance(j);
         return false;
       } else if (j == tries.expecting_operators_trie.longest_match(p.peek_str(j))) {
         p.current().flags |= RubyState::RubyInternalState::EXPECTING_EXPRESSION;
-        tokens->push_back({p.i, p.i + j, Token::KeywordOperator});
+        tokens->push_back({p.i, p.i + j, io::Token::KeywordOperator});
         p.advance(j);
         return false;
       } else if (j == tries.types_trie.longest_match(p.peek_str(j))) {
         p.current().flags |= RubyState::RubyInternalState::EXPECTING_EXPRESSION;
-        tokens->push_back({p.i, p.i + j, Token::Type});
+        tokens->push_back({p.i, p.i + j, io::Token::Type});
         p.advance(j);
         return false;
       } else if (j == tries.methods_trie.longest_match(p.peek_str(j))) {
         p.current().flags &= ~RubyState::RubyInternalState::EXPECTING_EXPRESSION;
-        tokens->push_back({p.i, p.i + j, Token::Function});
+        tokens->push_back({p.i, p.i + j, io::Token::Function});
         p.advance(j);
         return false;
       } else if (j == tries.expecting_end_keywords_trie.longest_match(p.peek_str(j))) {
         events->push_back(false);
         p.current().flags |= RubyState::RubyInternalState::EXPECTING_EXPRESSION;
-        tokens->push_back({p.i, p.i + j, Token::Keyword});
+        tokens->push_back({p.i, p.i + j, io::Token::Keyword});
         p.advance(j);
         return false;
       } else if (j == tries.conditional_keywords_trie.longest_match(p.peek_str(j))) {
         if (p.current().flags & RubyState::RubyInternalState::NEWLINE || p.op_last)
           events->push_back(false);
         p.current().flags |= RubyState::RubyInternalState::EXPECTING_EXPRESSION;
-        tokens->push_back({p.i, p.i + j, Token::Keyword});
+        tokens->push_back({p.i, p.i + j, io::Token::Keyword});
         p.advance(j);
         return false;
       } else if (j == tries.end_keywords_trie.longest_match(p.peek_str(j))) {
         p.current().flags |= RubyState::RubyInternalState::EXPECTING_EXPRESSION;
         events->push_back(false);
-        tokens->push_back({p.i, p.i + j, Token::Keyword});
+        tokens->push_back({p.i, p.i + j, io::Token::Keyword});
         p.advance(j);
         return false;
       } else if (j == tries.builtins_trie.longest_match(p.peek_str(j))) {
         p.current().flags &= ~RubyState::RubyInternalState::EXPECTING_EXPRESSION;
-        tokens->push_back({p.i, p.i + j, Token::Constant});
+        tokens->push_back({p.i, p.i + j, io::Token::Constant});
         p.advance(j);
         return false;
       } else if (j == tries.errors_trie.longest_match(p.peek_str(j))) {
         p.current().flags &= ~RubyState::RubyInternalState::EXPECTING_EXPRESSION;
-        tokens->push_back({p.i, p.i + j, Token::Error});
+        tokens->push_back({p.i, p.i + j, io::Token::Error});
         p.advance(j);
         return false;
       } else if ('A' <= p.peek() && p.peek() <= 'Z' && !(p.peek(j) == '!' || p.peek(j) == '?')) {
         p.current().flags &= ~RubyState::RubyInternalState::EXPECTING_EXPRESSION;
         if (j >= 5 && p.peek_str(j).substr(j - 5) == "Error") {
-          tokens->push_back({p.i, p.i + j, Token::Error});
+          tokens->push_back({p.i, p.i + j, io::Token::Error});
           p.advance(j);
           return false;
         }
-        tokens->push_back({p.i, p.i + j, Token::Constant});
+        tokens->push_back({p.i, p.i + j, io::Token::Constant});
         p.advance(j);
         return false;
       } else {
         p.current().flags &= ~RubyState::RubyInternalState::EXPECTING_EXPRESSION;
         if (j == 4 && p.peek_str(4) == "true") {
-          tokens->push_back({p.i, p.i + j, Token::True});
+          tokens->push_back({p.i, p.i + j, io::Token::True});
           p.advance(4);
           return false;
         }
         if (j == 5 && p.peek_str(5) == "false") {
-          tokens->push_back({p.i, p.i + j, Token::False});
+          tokens->push_back({p.i, p.i + j, io::Token::False});
           p.advance(5);
           return false;
         }
         if (j == 3 && p.peek_str(3) == "end") {
           events->push_back(true);
-          tokens->push_back({p.i, p.i + j, Token::Keyword});
+          tokens->push_back({p.i, p.i + j, io::Token::Keyword});
           p.advance(3);
           return false;
         }
         if (j == 5 && p.peek_str(5) == "class") {
-          tokens->push_back({p.i, p.i + j, Token::Keyword});
+          tokens->push_back({p.i, p.i + j, io::Token::Keyword});
           p.advance(5);
           p.current().flags =
             (p.current().flags & ~RubyState::RubyInternalState::NAME_MASK)
@@ -964,7 +981,7 @@ bool handle_syntax(RubyParser &p, std::vector<Token> *tokens, std::vector<ParseE
           return false;
         }
         if (j == 6 && p.peek_str(6) == "module") {
-          tokens->push_back({p.i, p.i + j, Token::Keyword});
+          tokens->push_back({p.i, p.i + j, io::Token::Keyword});
           p.advance(6);
           p.current().flags =
             (p.current().flags & ~RubyState::RubyInternalState::NAME_MASK)
@@ -972,28 +989,33 @@ bool handle_syntax(RubyParser &p, std::vector<Token> *tokens, std::vector<ParseE
           return false;
         }
         if (j == 3 && p.peek_str(3) == "def") {
-          tokens->push_back({p.i, p.i + j, Token::Keyword});
+          tokens->push_back({p.i, p.i + j, io::Token::Keyword});
           p.advance(3);
           p.current().flags =
             (p.current().flags & ~RubyState::RubyInternalState::NAME_MASK)
             | RubyState::RubyInternalState::DEF_NAME;
           return false;
         }
+        if (j > 3 && p.peek_str(3) == "to_") {
+          p.current().flags &= ~RubyState::RubyInternalState::EXPECTING_EXPRESSION;
+          tokens->push_back({p.i, p.i + j, io::Token::Function});
+          p.advance(j);
+        }
         uint32_t start = p.i;
         if (p.peek(j) == ':') {
           p.advance(j);
           p.advance();
-          tokens->push_back({start, p.i, Token::Label});
+          tokens->push_back({start, p.i, io::Token::Label});
           return false;
         } else if (p.peek(j - 1) == '!' || p.peek(j - 1) == '?') {
           p.advance(j);
-          tokens->push_back({start, p.i, Token::Function});
+          tokens->push_back({start, p.i, io::Token::Function});
           return false;
         } else {
           p.advance(j);
           j = 0;
           if (p.peek(j) == '(' || p.peek(j) == '{') {
-            tokens->push_back({start, p.i, Token::Function});
+            tokens->push_back({start, p.i, io::Token::Function});
             return false;
           } else if (p.peek(j) == ' ' || p.peek(j) == '\t') {
             j++;
@@ -1006,8 +1028,9 @@ bool handle_syntax(RubyParser &p, std::vector<Token> *tokens, std::vector<ParseE
             return false;
           if (p.peek(j) == '&'
               || p.peek(j) == '%'
-              || p.peek(j) == ':') {
-            if (p.peek(j + 1) == ' ' || p.peek(j + 1) == '>')
+              || p.peek(j) == ':'
+              || p.peek(j) == '?') {
+            if (p.peek(j + 1) == ' ' || p.peek(j + 1) == '\0')
               return false;
           } else if (p.peek(j) == '-') {
             if (p.peek(j + 1) != '>')
@@ -1023,22 +1046,22 @@ bool handle_syntax(RubyParser &p, std::vector<Token> *tokens, std::vector<ParseE
             || p.peek(j) == '*'
             || p.peek(j) == '/'
             || p.peek(j) == '='
-            || p.peek(j) == '?'
             || p.peek(j) == '|'
             || p.peek(j) == '^'
             || p.peek(j) == '<'
             || p.peek(j) == '>'
+            || p.peek(j) == '#'
           ) {
             return false;
           }
-          tokens->push_back({start, p.i, Token::Function});
+          tokens->push_back({start, p.i, io::Token::Function});
           return false;
         }
       }
     } else {
       uint32_t op_len;
       if ((op_len = tries.operator_trie.longest_match(p.peek_str(p.len() - p.i)))) {
-        tokens->push_back({p.i, p.i + op_len, Token::Operator});
+        tokens->push_back({p.i, p.i + op_len, io::Token::Operator});
         p.advance(op_len);
         p.current().flags |= RubyState::RubyInternalState::EXPECTING_EXPRESSION;
         p.set_op_last = true;
@@ -1054,17 +1077,17 @@ void ruby_parse(
   void **v_state,
   std::string_view line,
   bool fl,
-  std::vector<Token> *tokens,
+  std::vector<io::Token> *tokens,
   std::vector<ParseEvent> *events
 ) {
   RubyParser p(v_state, line);
-  while (p.i <= p.len()) {
+  while (p.i < p.len()) {
     p.op_last = p.set_op_last;
     p.set_op_last = false;
     if (p.current().state == RubyState::RubyInternalState::END)
       return;
     if (p.current().state == RubyState::RubyInternalState::COMMENT) {
-      tokens->push_back({p.i, p.len(), Token::Comment});
+      tokens->push_back({p.i, p.len(), io::Token::Comment});
       if (p.i == 0 && p.peek_str(4) == "=end") {
         p.current().state = RubyState::RubyInternalState::NONE;
         events->push_back(true);
@@ -1073,7 +1096,7 @@ void ruby_parse(
     }
     if (!p.heredoc_start_line
         && p.current().state == RubyState::RubyInternalState::HEREDOC) {
-      if (handle_heredoc(p, tokens))
+      if (handle_heredoc(p, tokens, events))
         return;
       else
         continue;
@@ -1096,6 +1119,13 @@ void ruby_parse(
       return;
     if (!handle_syntax(p, tokens, events))
       p.current().flags &= ~RubyState::RubyInternalState::NEWLINE;
+    if (p.peek() == '\0') {
+      if (p.ending)
+        p.current().flags |= RubyState::RubyInternalState::EXPECTING_EXPRESSION;
+      p.advance();
+      p.current().flags &= ~RubyState::RubyInternalState::NEWLINE;
+      break;
+    }
     continue;
   }
   if (p.ending)

src/internal/syntax/tree_cursor.cc

@@ -1,7 +1,19 @@
 #include "internal/syntax/decl.h"
 
 namespace bed::internal::syntax {
-TreeCursor::TreeCursor(ParseState *root, uint64_t target_line, uint64_t *relative) {
+TreeCursor::~TreeCursor() {
+  ParseState::release(lang, root);
+}
+
+TreeCursor::TreeCursor(
+  Language &lang, ParseState *root,
+  uint64_t target_line, uint64_t *relative
+) : lang(lang), root(root) {
+  if (!root) {
+    *relative = 0;
+    return;
+  }
+  ParseState::retain(root);
   ParseState *node = root;
   while (node->is_branch()) {
     auto *branch = (ParseStateBranch *)node;
@@ -63,4 +75,42 @@ void TreeCursor::prev() {
   }
   leaf = nullptr;
 }
+
+ParseState *TreeCursor::prefix() {
+  ParseState *result = nullptr;
+  for (uint8_t i = 0; i < depth; ++i) {
+    if (went_left[i])
+      continue;
+    auto *branch = stack[i];
+    ParseState *piece = branch->left;
+    if (!result) {
+      ParseState::retain(piece);
+      result = piece;
+    } else {
+      ParseState *next = ParseState::concat(lang, result, piece);
+      ParseState::release(lang, result);
+      result = next;
+    }
+  }
+  return result;
+}
+
+ParseState *TreeCursor::suffix() {
+  ParseState *result = nullptr;
+  for (uint8_t i = depth; i-- > 0;) {
+    if (!went_left[i])
+      continue;
+    auto *branch = stack[i];
+    ParseState *piece = branch->right;
+    if (!result) {
+      ParseState::retain(piece);
+      result = piece;
+    } else {
+      ParseState *next = ParseState::concat(lang, result, piece);
+      ParseState::release(lang, result);
+      result = next;
+    }
+  }
+  return result;
+}
 } // namespace bed::internal::syntax

src/internal/theme/theme.cc

@@ -5,150 +5,248 @@ Theme::Theme() {
   hl.fill({
     .fg = 0xF0F0F0,
     .bg = 0x000000,
-    .flags = Highlight::None,
+    .flags = io::Highlight::None,
   });
 }
 
-Highlight Theme::get(internal::syntax::Token token) const {
-  return hl[token.type];
+io::Highlight Theme::get(const io::Token::Kind &token) const {
+  return hl[token];
 }
 
 Theme Theme::default_theme() {
   Theme theme;
-  theme.hl[internal::syntax::Token::Shebang] = {
-    .fg = 0x7DCFFF,
+
+  constexpr uint32_t PINK = 0xECA1AE;
+  constexpr uint32_t GREY = 0xAFB7D3;
+  constexpr uint32_t BLUE = 0x799EDB;
+  constexpr uint32_t LIGHT_BLUE = 0xB5BFFE;
+  constexpr uint32_t RED = 0xF38CAA;
+  constexpr uint32_t YELLOW = 0xF9E3B1;
+  constexpr uint32_t PURPLE = 0xA286C7;
+  constexpr uint32_t CYAN = 0x89DBEA;
+  constexpr uint32_t LIGHT_GREEN = 0x98CE94;
+  constexpr uint32_t TURQUOISE = 0x00BDB7;
+  constexpr uint32_t BRIGHT_GREEN = 0x4AF6CA;
+
+  theme.hl[io::Token::TempCurrent] = {
+    .fg = PINK,
     .bg = 0x000000,
-    .flags = Highlight::None,
+    .flags = io::Highlight::None,
   };
-  theme.hl[internal::syntax::Token::Error] = {
-    .fg = 0xEF5168,
+  theme.hl[io::Token::BufferName] = {
+    .fg = PURPLE,
     .bg = 0x000000,
-    .flags = Highlight::None,
+    .flags = io::Highlight::None,
   };
-  theme.hl[internal::syntax::Token::Comment] = {
-    .fg = 0xAAAAAA,
+  theme.hl[io::Token::AddressSeperator] = {
+    .fg = GREY,
     .bg = 0x000000,
-    .flags = Highlight::Italic,
+    .flags = io::Highlight::None,
   };
-  theme.hl[internal::syntax::Token::String] = {
+  theme.hl[io::Token::AddressSymbol] = {
+    .fg = BLUE,
+    .bg = 0x000000,
+    .flags = io::Highlight::None,
+  };
+  theme.hl[io::Token::Mark] = {
+    .fg = LIGHT_BLUE,
+    .bg = 0x000000,
+    .flags = io::Highlight::None,
+  };
+  theme.hl[io::Token::RubyFunction] = {
+    .fg = RED,
+    .bg = 0x000000,
+    .flags = io::Highlight::None,
+  };
+  theme.hl[io::Token::RubyArg] = {
+    .fg = LIGHT_GREEN,
+    .bg = 0x000000,
+    .flags = io::Highlight::None,
+  };
+  theme.hl[io::Token::Shell] = {
+    .fg = BRIGHT_GREEN,
+    .bg = 0x000000,
+    .flags = io::Highlight::None,
+  };
+  theme.hl[io::Token::File] = {
+    .fg = GREY,
+    .bg = 0x000000,
+    .flags = io::Highlight::None,
+  };
+  theme.hl[io::Token::Suffix] = {
+    .fg = TURQUOISE,
+    .bg = 0x000000,
+    .flags = io::Highlight::None,
+  };
+  theme.hl[io::Token::Color1] = {
+    .fg = 0x7AA2F7,
+    .bg = 0x000000,
+    .flags = io::Highlight::None,
+  };
+  theme.hl[io::Token::Color2] = {
     .fg = 0xAAD94C,
     .bg = 0x000000,
-    .flags = Highlight::None,
+    .flags = io::Highlight::None,
   };
-  theme.hl[internal::syntax::Token::Escape] = {
+  theme.hl[io::Token::Color3] = {
+    .fg = 0xFF9E64,
+    .bg = 0x000000,
+    .flags = io::Highlight::None,
+  };
+  theme.hl[io::Token::Color4] = {
+    .fg = 0xBB9AF7,
+    .bg = 0x000000,
+    .flags = io::Highlight::None,
+  };
+  theme.hl[io::Token::Color5] = {
+    .fg = 0xFF757F,
+    .bg = 0x000000,
+    .flags = io::Highlight::None,
+  };
+  theme.hl[io::Token::Warning] = {
+    .fg = 0xF1C55A,
+    .bg = 0x000000,
+    .flags = io::Highlight::None,
+  };
+  theme.hl[io::Token::Data] = {
+    .fg = GREY,
+    .bg = 0x000000,
+    .flags = io::Highlight::None,
+  };
+  theme.hl[io::Token::Shebang] = {
     .fg = 0x7DCFFF,
     .bg = 0x000000,
-    .flags = Highlight::None,
+    .flags = io::Highlight::None,
   };
-  theme.hl[internal::syntax::Token::Interpolation] = {
-    .fg = 0x7DCFFF,
-    .bg = 0x000000,
-    .flags = Highlight::None,
-  };
-  theme.hl[internal::syntax::Token::Regexp] = {
-    .fg = 0xD2A6FF,
-    .bg = 0x000000,
-    .flags = Highlight::None,
-  };
-  theme.hl[internal::syntax::Token::Number] = {
-    .fg = 0xE6C08A,
-    .bg = 0x000000,
-    .flags = Highlight::None,
-  };
-  theme.hl[internal::syntax::Token::True] = {
-    .fg = 0x7AE93C,
-    .bg = 0x000000,
-    .flags = Highlight::None,
-  };
-  theme.hl[internal::syntax::Token::False] = {
+  theme.hl[io::Token::Error] = {
     .fg = 0xEF5168,
     .bg = 0x000000,
-    .flags = Highlight::None,
+    .flags = io::Highlight::None,
   };
-  theme.hl[internal::syntax::Token::Char] = {
+  theme.hl[io::Token::Comment] = {
+    .fg = 0xAAAAAA,
+    .bg = 0x000000,
+    .flags = io::Highlight::Italic,
+  };
+  theme.hl[io::Token::String] = {
+    .fg = 0xAAD94C,
+    .bg = 0x000000,
+    .flags = io::Highlight::None,
+  };
+  theme.hl[io::Token::Escape] = {
+    .fg = 0x7DCFFF,
+    .bg = 0x000000,
+    .flags = io::Highlight::None,
+  };
+  theme.hl[io::Token::Interpolation] = {
+    .fg = 0x7DCFFF,
+    .bg = 0x000000,
+    .flags = io::Highlight::None,
+  };
+  theme.hl[io::Token::Regexp] = {
+    .fg = 0x7DCFFF,
+    .bg = 0x000000,
+    .flags = io::Highlight::None,
+  };
+  theme.hl[io::Token::Number] = {
+    .fg = 0xE6C08A,
+    .bg = 0x000000,
+    .flags = io::Highlight::None,
+  };
+  theme.hl[io::Token::True] = {
+    .fg = 0x7AE93C,
+    .bg = 0x000000,
+    .flags = io::Highlight::None,
+  };
+  theme.hl[io::Token::False] = {
+    .fg = 0xEF5168,
+    .bg = 0x000000,
+    .flags = io::Highlight::None,
+  };
+  theme.hl[io::Token::Char] = {
     .fg = 0xFFAF70,
     .bg = 0x000000,
-    .flags = Highlight::None,
+    .flags = io::Highlight::None,
   };
-  theme.hl[internal::syntax::Token::Keyword] = {
+  theme.hl[io::Token::Keyword] = {
     .fg = 0xFF8F40,
     .bg = 0x000000,
-    .flags = Highlight::None,
+    .flags = io::Highlight::None,
   };
-  theme.hl[internal::syntax::Token::KeywordOperator] = {
+  theme.hl[io::Token::KeywordOperator] = {
     .fg = 0xF07178,
     .bg = 0x000000,
-    .flags = Highlight::None,
+    .flags = io::Highlight::None,
   };
-  theme.hl[internal::syntax::Token::Operator] = {
+  theme.hl[io::Token::Operator] = {
     .fg = 0xFFFFFF,
     .bg = 0x000000,
-    .flags = Highlight::Italic,
+    .flags = io::Highlight::Italic,
   };
-  theme.hl[internal::syntax::Token::Function] = {
+  theme.hl[io::Token::Function] = {
     .fg = 0xFFAF70,
     .bg = 0x000000,
-    .flags = Highlight::None,
+    .flags = io::Highlight::None,
   };
-  theme.hl[internal::syntax::Token::Type] = {
+  theme.hl[io::Token::Type] = {
     .fg = 0xF07178,
     .bg = 0x000000,
-    .flags = Highlight::None,
+    .flags = io::Highlight::None,
   };
-  theme.hl[internal::syntax::Token::Constant] = {
+  theme.hl[io::Token::Constant] = {
     .fg = 0x7DCFFF,
     .bg = 0x000000,
-    .flags = Highlight::None,
+    .flags = io::Highlight::None,
   };
-  theme.hl[internal::syntax::Token::VariableInstance] = {
+  theme.hl[io::Token::VariableInstance] = {
     .fg = 0x95E6CB,
     .bg = 0x000000,
-    .flags = Highlight::None,
+    .flags = io::Highlight::None,
   };
-  theme.hl[internal::syntax::Token::VariableGlobal] = {
+  theme.hl[io::Token::VariableGlobal] = {
     .fg = 0xF07178,
     .bg = 0x000000,
-    .flags = Highlight::None,
+    .flags = io::Highlight::None,
   };
-  theme.hl[internal::syntax::Token::Annotation] = {
+  theme.hl[io::Token::Annotation] = {
     .fg = 0x7DCFFF,
     .bg = 0x000000,
-    .flags = Highlight::None,
+    .flags = io::Highlight::None,
   };
-  theme.hl[internal::syntax::Token::Directive] = {
+  theme.hl[io::Token::Directive] = {
     .fg = 0xFF8F40,
     .bg = 0x000000,
-    .flags = Highlight::None,
+    .flags = io::Highlight::None,
   };
-  theme.hl[internal::syntax::Token::Label] = {
+  theme.hl[io::Token::Label] = {
     .fg = 0xD2A6FF,
     .bg = 0x000000,
-    .flags = Highlight::None,
+    .flags = io::Highlight::None,
   };
-  theme.hl[internal::syntax::Token::Brace1] = {
-    .fg = 0xD2A6FF,
+  theme.hl[io::Token::Brace1] = {
+    .fg = BRIGHT_GREEN,
     .bg = 0x000000,
-    .flags = Highlight::None,
+    .flags = io::Highlight::None,
   };
-  theme.hl[internal::syntax::Token::Brace2] = {
-    .fg = 0xFFAFAF,
+  theme.hl[io::Token::Brace2] = {
+    .fg = YELLOW,
     .bg = 0x000000,
-    .flags = Highlight::None,
+    .flags = io::Highlight::None,
   };
-  theme.hl[internal::syntax::Token::Brace3] = {
+  theme.hl[io::Token::Brace3] = {
     .fg = 0xFFFF00,
     .bg = 0x000000,
-    .flags = Highlight::None,
+    .flags = io::Highlight::None,
   };
-  theme.hl[internal::syntax::Token::Brace4] = {
-    .fg = 0x0FFF0F,
+  theme.hl[io::Token::Brace4] = {
+    .fg = CYAN,
     .bg = 0x000000,
-    .flags = Highlight::None,
+    .flags = io::Highlight::None,
   };
-  theme.hl[internal::syntax::Token::Brace5] = {
+  theme.hl[io::Token::Brace5] = {
     .fg = 0xFF0F0F,
     .bg = 0x000000,
-    .flags = Highlight::None,
+    .flags = io::Highlight::None,
   };
   return theme;
 }
@@ -156,7 +254,6 @@ Theme Theme::default_theme() {
 Theme Theme::from_name(std::string_view name) {
   if (name == "default")
     return default_theme();
-  throw std::runtime_error("Unknown theme: " + std::string(name));
+  throw ed_error("Unknown theme: " + std::string(name));
 }
-
 } // namespace bed::internal::theme

src/internal/ui/command/command.cc

@@ -0,0 +1,124 @@
+#include "internal/ui/command.h"
+#include "bed.h"
+#include "internal/parser/parser.h"
+
+namespace bed::internal::ui {
+CommandIO::CommandIO(BEd &bed) : bed(bed) {
+  if (bed.prompt_mode)
+    prompt = bed.prompt(bed);
+  cursor = 0;
+}
+
+std::pair<std::string, bool> CommandIO::run() {
+  if (!bed.io.interactive())
+    return run_pipe();
+  return run_terminal();
+}
+
+std::pair<std::string, bool> CommandIO::run_pipe() {
+  bed.io.write(prompt);
+  return bed.io.read_pipe();
+}
+
+std::pair<std::string, bool> CommandIO::run_terminal() {
+  auto [row, col] = bed.io.cursor_position();
+  auto [rows, cols] = bed.io.terminal_size();
+  if (row > rows)
+    throw fatal_error("Invalid cursor position.", 1);
+  start = row;
+  height = rows - row + 1;
+  term_width = cols;
+  term_height = rows;
+  redraw();
+
+  io::KeyEvent res;
+  bool running = true;
+  while (running) {
+    res = bed.io.read_key();
+    switch (res.type) {
+    case io::KeyEvent::KeyType::EOF_:
+      running = false;
+      break;
+    case io::KeyEvent::KeyType::MOUSE:
+    case io::KeyEvent::KeyType::RESIZE:
+      break;
+    case io::KeyEvent::KeyType::CHAR:
+      switch (res.modifier) {
+      case io::KeyEvent::Modifier::SHIFT:
+      case io::KeyEvent::Modifier::ALT:
+      case io::KeyEvent::Modifier::CTRL_ALT:
+      case io::KeyEvent::Modifier::CTRL:
+        break;
+      case io::KeyEvent::Modifier::NONE:
+        if (res.text[0] == '\b' || res.text[0] == 0x7f) {
+          if (cursor > 0)
+            cmd.erase(--cursor, 1);
+        } else if (res.text[0] == '\n') {
+          running = false;
+        } else {
+          cmd.insert(cursor++, res.text);
+        }
+        break;
+      }
+      break;
+    case io::KeyEvent::KeyType::PASTE:
+      cmd.insert(cursor, res.text);
+      cursor += res.text.size();
+      break;
+    case io::KeyEvent::KeyType::SPECIAL:
+      switch (res.special_key) {
+      case io::KeyEvent::SpecialKey::UNKNOWN:
+      case io::KeyEvent::SpecialKey::UP:
+      case io::KeyEvent::SpecialKey::DOWN:
+        break;
+      case io::KeyEvent::SpecialKey::RIGHT:
+        if (cursor < cmd.size())
+          cursor++;
+        break;
+      case io::KeyEvent::SpecialKey::LEFT:
+        if (cursor > 0)
+          cursor--;
+        break;
+      case io::KeyEvent::SpecialKey::DELETE:
+        if (cursor < cmd.size())
+          cmd.erase(cursor, 1);
+        break;
+      }
+      break;
+    }
+    redraw();
+  }
+
+  for (uint16_t i = 1; i < height; ++i) {
+    bed.io.move_cursor(start + i, 1);
+    bed.io.write("\x1b[2K", 4);
+  }
+  bed.io.move_cursor(start, 1);
+  bed.io.write("\n", 1);
+  return {cmd, false};
+}
+
+void CommandIO::redraw() {
+  bed.io.move_cursor(start, 1);
+  bed.io.write("\x1b[2K", 4);
+  bed.io.move_cursor(start, 1);
+  bed.io.write(prompt);
+  const auto tokens = parser::Parser::get_highlight(cmd, bed);
+  uint32_t pos = 0;
+  for (const auto &token : tokens) {
+    const uint32_t tstart = token.start;
+    const uint32_t tend = token.end;
+    if (tstart > cmd.size())
+      break;
+    if (pos < tstart)
+      bed.io.write(cmd.data() + pos, tstart - pos);
+    bed.io.apply(token.type);
+    bed.io.write(cmd.data() + tstart, tend - tstart);
+    bed.io.reset();
+    pos = tend;
+  }
+  if (pos < cmd.size())
+    bed.io.write(cmd.data() + pos, cmd.size() - pos);
+  bed.io.move_cursor(start, prompt.size() + cursor + 1);
+}
+} // namespace bed::internal::ui

src/internal/ui/text_mode/text_mode.cc

@@ -0,0 +1,428 @@
+#include "internal/ui/text_mode.h"
+#include "bed.h"
+
+namespace bed::internal::ui::text_mode {
+// TODO: make this into a proper layout engine, in order to avoid so many expensive calculations repeatedly.
+
+template <typename F>
+static void for_each_cluster(std::string_view s, F &&f) {
+  size_t cluster_start = 0;
+  while (cluster_start < s.size()) {
+    size_t cluster_len =
+      grapheme_next_character_break_utf8(
+        s.data() + cluster_start,
+        s.size() - cluster_start
+      );
+    if (cluster_len == 0)
+      break;
+    size_t cluster_end = cluster_start + cluster_len;
+    unicode_width_state_t state;
+    unicode_width_init(&state);
+    size_t i = cluster_start;
+    int width = 0;
+    while (i < cluster_end) {
+      uint_least32_t cp;
+      size_t decoded =
+        grapheme_decode_utf8(s.data() + i, cluster_end - i, &cp);
+      if (decoded == 0)
+        decoded = 1;
+      int w = unicode_width_process(&state, cp);
+      if (w > width)
+        width = w;
+      i += decoded;
+    }
+    if (width < 0)
+      width = 0;
+    if (!f(cluster_start, cluster_len, width))
+      return;
+    cluster_start = cluster_end;
+  }
+}
+
+static size_t previous_cluster(std::string_view line, size_t col) {
+  size_t previous = 0;
+  for_each_cluster(line, [&](size_t start, size_t len, int) {
+    if (start >= col)
+      return false;
+    previous = start;
+    return start + len < col;
+  });
+  return previous;
+}
+
+static size_t next_cluster(std::string_view line, size_t col) {
+  size_t next = line.size();
+  for_each_cluster(line, [&](size_t start, size_t len, int) {
+    if (start >= col) {
+      next = start + len;
+      return false;
+    }
+    return true;
+  });
+  return next;
+}
+
+static size_t visual_column(std::string_view line, size_t col) {
+  size_t width = 0;
+  for_each_cluster(line, [&](size_t start, size_t, int cluster_width) {
+    if (start >= col)
+      return false;
+    width += cluster_width;
+    return true;
+  });
+  return width;
+}
+
+static size_t byte_column(std::string_view line, size_t target_width) {
+  size_t width = 0;
+  size_t col = 0;
+  for_each_cluster(line, [&](size_t start, size_t len, int cluster_width) {
+    if (width + cluster_width > target_width)
+      return false;
+    width += cluster_width;
+    col = start + len;
+    if (width == target_width)
+      return false;
+    return true;
+  });
+  return col;
+}
+
+static std::vector<std::pair<size_t, size_t>> wrap_line(std::string_view line, size_t avail) {
+  std::vector<std::pair<size_t, size_t>> result;
+  if (avail == 0) {
+    result.push_back({0, line.size()});
+    return result;
+  }
+  size_t begin = 0;
+  size_t end = 0;
+  int col = 0;
+  for_each_cluster(line, [&](size_t i, size_t len, int width) {
+    if (col > 0 && col + width > int(avail)) {
+      result.push_back({begin, i});
+      begin = i;
+      col = 0;
+    }
+    col += width;
+    end = i + len;
+    return true;
+  });
+  if (begin < line.size() || result.empty())
+    result.push_back({begin, end});
+  return result;
+}
+
+void TextMode::layout_lines() {
+  vase::Iterator it(vase, 0, Direction::Forward);
+  lines.clear();
+  while (it.next()) {
+    auto wrapped = wrap_line(it.line, term_width);
+    lines.push_back({});
+    for (auto [begin, end] : wrapped)
+      lines.back().push_back({begin, end - begin});
+  }
+}
+
+TextMode::TextMode(
+  BEd &bed, vase::Shard *vase, syntax::Language *lang, void *state
+) : vase(vase), bed(bed) {
+  if (lang)
+    parser.emplace(*lang, vase, state);
+  cursor = vase::eof_point(vase);
+}
+
+std::pair<vase::Shard *, bool> TextMode::run() {
+  if (!bed.io.interactive())
+    return run_pipe();
+  return run_terminal();
+}
+
+std::pair<vase::Shard *, bool> TextMode::run_pipe() {
+  vase::Shard::release(vase);
+  vase = nullptr;
+  while (true) {
+    auto [str, eof] = bed.io.read_pipe();
+    if (str == "." || eof)
+      break;
+    vase = vase::insert(&bed.append, vase, &cursor, str.data(), str.length());
+    vase = vase::insert(&bed.append, vase, &cursor, '\n');
+  }
+  return {vase, false};
+}
+
+std::pair<vase::Shard *, bool> TextMode::run_terminal() {
+  auto [row, col] = bed.io.cursor_position();
+  auto [rows, cols] = bed.io.terminal_size();
+  if (row > rows)
+    throw ed_error("Invalid cursor position.");
+  start = row;
+  height = rows - row + 1;
+  term_width = cols;
+  term_height = rows;
+  redraw();
+  bool running = true;
+  bool cancelled = false;
+
+  while (running) {
+    redraw();
+    io::KeyEvent res = bed.io.read_key();
+    switch (res.type) {
+    case io::KeyEvent::KeyType::EOF_:
+      running = false;
+      break;
+    case io::KeyEvent::KeyType::MOUSE:
+    case io::KeyEvent::KeyType::RESIZE:
+      break;
+    case io::KeyEvent::KeyType::CHAR:
+      switch (res.modifier) {
+      case io::KeyEvent::Modifier::SHIFT:
+      case io::KeyEvent::Modifier::ALT:
+      case io::KeyEvent::Modifier::CTRL_ALT:
+      case io::KeyEvent::Modifier::CTRL:
+        if (res.text[0] == 'c') {
+          cancelled = true;
+          running = false;
+        }
+        break;
+      case io::KeyEvent::Modifier::NONE:
+        if (res.text[0] == '\b' || res.text[0] == 0x7f) {
+          if (!vase)
+            break;
+          if (cursor.row || cursor.col) {
+            auto last = cursor;
+            if (last.col) {
+              vase::Iterator it(vase, last.row, Direction::Forward);
+              if (!it.next())
+                throw ed_error("Invalid cursor position.");
+              last.col = previous_cluster(it.line, last.col);
+            } else if (last.row) {
+              --last.row;
+              vase::Iterator it(vase, last.row, Direction::Forward);
+              if (!it.next())
+                throw ed_error("Invalid cursor position.");
+              last.col = it.line.size();
+            } else {
+              break;
+            }
+            vase::Range r = {last, cursor};
+            vase = vase::erase(vase, r);
+            if (parser) {
+              if (cursor.row == last.row) {
+                parser->dirty(vase, cursor.row, 1);
+              } else {
+                parser->erase(vase, cursor.row, 1);
+                parser->dirty(vase, last.row, 1);
+              }
+            }
+            cursor = last;
+          }
+        } else if (res.text[0] == '\n') {
+          if (vase && cursor.row == vase->lines) {
+            vase::Iterator it(vase, vase->lines, Direction::Backward);
+            if (it.next() && it.line == ".") {
+              vase = vase::erase(vase, vase->lines + 1, vase->lines + 1);
+              running = false;
+              break;
+            }
+          }
+          vase = vase::insert(&bed.append, vase, &cursor, '\n');
+          if (parser)
+            parser->insert(vase, cursor.row - 1, 1);
+        } else {
+          vase = vase::insert(&bed.append, vase, &cursor, res.text.data(), res.text.size());
+          if (parser)
+            parser->dirty(vase, cursor.row, 1);
+        }
+        break;
+      }
+      break;
+    case io::KeyEvent::KeyType::PASTE: {
+      auto lines = std::count(res.text.begin(), res.text.end(), '\n');
+      vase = vase::insert(&bed.append, vase, &cursor, res.text.data(), res.text.size());
+      if (parser) {
+        if (lines) {
+          parser->insert(vase, cursor.row - lines, lines);
+          parser->dirty(vase, cursor.row - lines, 1);
+        } else {
+          parser->dirty(vase, cursor.row, 1);
+        }
+      }
+    } break;
+    case io::KeyEvent::KeyType::SPECIAL:
+      if (!vase)
+        break;
+      switch (res.special_key) {
+      case io::KeyEvent::SpecialKey::UNKNOWN:
+        break;
+      case io::KeyEvent::SpecialKey::RIGHT: {
+        vase::Iterator it(vase, cursor.row, Direction::Forward);
+        if (!it.next())
+          throw ed_error("Invalid cursor position.");
+        cursor.col = next_cluster(it.line, cursor.col);
+      } break;
+      case io::KeyEvent::SpecialKey::LEFT: {
+        vase::Iterator it(vase, cursor.row, Direction::Forward);
+        if (!it.next())
+          throw ed_error("Invalid cursor position.");
+        cursor.col = previous_cluster(it.line, cursor.col);
+      } break;
+      case io::KeyEvent::SpecialKey::UP: {
+        if (!cursor.row)
+          break;
+        vase::Iterator current(vase, cursor.row, Direction::Forward);
+        if (!current.next())
+          throw ed_error("Invalid cursor position.");
+        size_t wanted = visual_column(current.line, cursor.col);
+        --cursor.row;
+        vase::Iterator previous(vase, cursor.row, Direction::Forward);
+        if (!previous.next())
+          throw ed_error("Invalid cursor position.");
+        cursor.col = byte_column(previous.line, wanted);
+      } break;
+      case io::KeyEvent::SpecialKey::DOWN: {
+        if (cursor.row >= vase->lines)
+          break;
+        vase::Iterator current(vase, cursor.row, Direction::Forward);
+        if (!current.next())
+          throw ed_error("Invalid cursor position.");
+        size_t wanted = visual_column(current.line, cursor.col);
+        ++cursor.row;
+        vase::Iterator previous(vase, cursor.row, Direction::Forward);
+        if (!previous.next())
+          throw ed_error("Invalid cursor position.");
+        cursor.col = byte_column(previous.line, wanted);
+      } break;
+      case io::KeyEvent::SpecialKey::DELETE:
+        auto next = cursor;
+        vase::Iterator it(vase, cursor.row, Direction::Forward);
+        if (!it.next())
+          break;
+        if (cursor.col < it.line.size()) {
+          vase::Iterator it(vase, next.row, Direction::Forward);
+          if (!it.next())
+            throw ed_error("Invalid cursor position.");
+          next.col = next_cluster(it.line, cursor.col);
+        } else if (cursor.row < vase->lines) {
+          ++next.row;
+          next.col = 0;
+        } else {
+          break;
+        }
+        vase::Range r = {cursor, next};
+        vase = vase::erase(vase, r);
+        if (parser) {
+          if (cursor.row != next.row)
+            parser->erase(vase, cursor.row + 1, 1);
+          parser->dirty(vase, cursor.row, 1);
+        }
+      }
+      break;
+    }
+  }
+
+  layout_lines();
+  size_t required_height = 0;
+  for (const auto &elem : lines)
+    required_height += elem.size();
+  uint16_t last_row = start + required_height;
+  bed.io.move_cursor(last_row, 1);
+  bed.io.write("\n");
+  return {vase, cancelled};
+}
+
+void TextMode::grow() {
+  size_t required_height = 0;
+  for (const auto &elem : lines)
+    required_height += elem.size();
+  auto [rows, cols] = bed.io.terminal_size();
+  term_height = rows;
+  term_width = cols;
+  if (required_height > height)
+    height = required_height;
+  long overflow = long(start) + long(height) - 1 - long(rows);
+  if (overflow <= 0)
+    return;
+  bed.io.move_cursor(rows, 1);
+  for (long i = 0; i < overflow; ++i)
+    bed.io.write("\n");
+  start -= overflow;
+  if (start < 1)
+    start = 1;
+}
+
+void TextMode::redraw() {
+  layout_lines();
+  grow();
+  bed.io.write("\x1b[?25l", 6);
+  for (uint16_t i = 0; i < height; ++i) {
+    bed.io.move_cursor(start + i, 1);
+    bed.io.write("\x1b[2K", 4);
+  }
+  uint16_t screen_line = start;
+  uint64_t line = 0;
+  size_t cursor_screen_row = start;
+  size_t cursor_screen_col = 0;
+  vase::Iterator it(vase, line, Direction::Forward);
+  while (it.next()) {
+    if (screen_line >= start + height)
+      break;
+    std::string_view l(it.line);
+    const std::vector<io::Token> *tokens = nullptr;
+    if (parser && parser->lines.size() > line)
+      tokens = &parser->lines[line].second;
+    size_t token_index = 0;
+    for (auto &row : lines[line]) {
+      const size_t row_start = row.start;
+      const size_t row_end = row.start + row.length;
+      bed.io.move_cursor(screen_line, 1);
+      if (tokens) {
+        while (token_index < tokens->size() && (*tokens)[token_index].end <= row_start)
+          ++token_index;
+        size_t pos = row_start;
+        for (size_t i = token_index; i < tokens->size(); ++i) {
+          const auto &token = (*tokens)[i];
+          if (token.start >= row_end)
+            break;
+          const size_t begin = std::max<size_t>(
+            token.start,
+            row_start
+          );
+          const size_t end = std::min<size_t>(
+            token.end,
+            row_end
+          );
+          if (begin > pos)
+            bed.io.write(l.data() + pos, begin - pos);
+          if (begin < end) {
+            bed.io.apply(token.type);
+            bed.io.write(l.data() + begin, end - begin);
+            bed.io.reset();
+            pos = end;
+          }
+        }
+        if (pos < row_end)
+          bed.io.write(l.data() + pos, row_end - pos);
+        bed.io.reset();
+      } else {
+        bed.io.write(l.substr(row_start, row.length));
+      }
+      if (line == cursor.row && cursor.col >= row_start && cursor.col <= row_end) {
+        cursor_screen_row = screen_line;
+        cursor_screen_col = 0;
+        for_each_cluster(
+          l.substr(row_start, cursor.col - row_start),
+          [&](size_t, size_t, int width) {
+            cursor_screen_col += width;
+            return true;
+          }
+        );
+      }
+      ++screen_line;
+    }
+    ++line;
+  }
+  cursor_screen_col = std::min(cursor_screen_col, size_t(term_width - 1));
+  bed.io.move_cursor(cursor_screen_row, cursor_screen_col + 1);
+  bed.io.write("\x1b[?25h", 6);
+}
+} // namespace bed::internal::ui::text_mode

src/internal/vase/regex/api.cc

@@ -25,12 +25,7 @@ std::vector<ReplacePart> parse_replace(AppendStorage *ap, std::string_view s) {
   };
   for (size_t i = 0; i < s.size(); ++i) {
     char c = s[i];
-    if (c == '\\' && i + 1 < s.size() && s[i + 1] == '$') {
-      constant.push_back('$');
-      ++i;
-      continue;
-    }
-    if (c == '$' && i + 1 < s.size()) {
+    if (c == '\\' && i + 1 < s.size()) {
       char next = s[i + 1];
       if (next == '0') {
         flush_constant();
@@ -40,10 +35,7 @@ std::vector<ReplacePart> parse_replace(AppendStorage *ap, std::string_view s) {
             .value = (uint8_t)0
           }
         );
-        ++i;
-        continue;
-      }
-      if (next >= '1' && next <= '9') {
+      } else if (next >= '1' && next <= '9') {
         flush_constant();
         parts.push_back(
           ReplacePart{
@@ -51,9 +43,22 @@ std::vector<ReplacePart> parse_replace(AppendStorage *ap, std::string_view s) {
             .value = (uint8_t)(next - '0')
           }
         );
+      } else if (next == 'n') {
+        constant.push_back('\n');
+      } else {
+        constant.push_back(next);
+      }
       ++i;
       continue;
     }
+    if (c == '&') {
+      flush_constant();
+      parts.push_back(
+        ReplacePart{
+          .type = ReplacePart::PartType::FullMatch,
+          .value = (uint8_t)0
+        }
+      );
     }
     constant.push_back(c);
   }
@@ -64,7 +69,8 @@ std::vector<ReplacePart> parse_replace(AppendStorage *ap, std::string_view s) {
 Shard *substitute(
   AppendStorage *ap, Shard *root,
   std::string_view pattern, uint64_t start, uint64_t end,
-  std::string_view replace, std::string_view options
+  std::string_view replace, std::string_view options,
+  const std::function<void(uint64_t line, uint64_t old_lines, uint64_t new_lines)> &on_edit
 ) {
   if (!start || !end)
     throw ed_error("Invalid range.");
@@ -79,21 +85,18 @@ Shard *substitute(
   uint64_t end_offset =
     (end + 1 == line_count)
       ? root->length
-      : offset_of(root, end + 1);
-
+      : offset_of(root, end + 1) - 1;
   std::vector<RegexMatch> matches = _regex_search(root, pattern, start_offset, end_offset, options);
   if (matches.empty())
     return root;
-
   std::vector<ReplacePart> replace_parts = parse_replace(ap, replace);
-
+  uint64_t current_line = 1;
+  int64_t line_delta = 0;
   std::vector<Shard *> pieces;
   pieces.reserve(matches.size() * 2 + 1);
-
   Shard *remaining = root;
   Shard::retain(remaining);
   uint64_t cursor = 0;
-
   for (const RegexMatch &match : matches) {
     uint64_t gap = match.start - cursor;
     if (gap > 0) {
@@ -101,28 +104,33 @@ Shard *substitute(
       Shard::release(remaining);
       pieces.push_back(keep);
       remaining = rest;
+      current_line += keep ? keep->lines : 0;
     }
-
     auto [dropped, rest2] = Shard::split(remaining, match.end - match.start);
     Shard::release(remaining);
     remaining = rest2;
-
+    uint64_t old_lines = dropped ? dropped->lines : 0;
+    uint64_t new_lines = 0;
     for (size_t i = 0; i < replace_parts.size(); ++i) {
       const ReplacePart &part = replace_parts[i];
       switch (part.type) {
-      case ReplacePart::PartType::Constant:
-        Shard::retain(std::get<Shard *>(part.value));
-        pieces.push_back(std::get<Shard *>(part.value));
+      case ReplacePart::PartType::Constant: {
+        Shard *c = std::get<Shard *>(part.value);
+        Shard::retain(c);
+        pieces.push_back(c);
+        new_lines += c ? c->lines : 0;
         break;
+      }
       case ReplacePart::PartType::FullMatch:
         Shard::retain(dropped);
         pieces.push_back(dropped);
+        new_lines += dropped ? dropped->lines : 0;
         break;
       case ReplacePart::PartType::CaptureGroup: {
         uint8_t idx = std::get<uint8_t>(part.value);
         if (idx <= 9) {
           const RegexGroup &group = match.groups[idx - 1];
-          if (group.start > group.end) {
+          if (group.start != UINT64_MAX) {
             uint64_t ls = group.start - match.start;
             uint64_t le = group.end - match.start;
             auto [a, b] = Shard::split(dropped, ls);
@@ -131,6 +139,7 @@ Shard *substitute(
             Shard::release(b);
             Shard::release(c);
             pieces.push_back(g);
+            new_lines += g ? g->lines : 0;
           }
         }
         break;
@@ -138,14 +147,17 @@ Shard *substitute(
       }
     }
     Shard::release(dropped);
+    uint64_t report_line = (uint64_t)((int64_t)current_line + line_delta);
+    if (on_edit)
+      on_edit(report_line, old_lines, new_lines);
+    line_delta += (int64_t)new_lines - (int64_t)old_lines;
+    current_line += old_lines;
     cursor = match.end;
   }
   pieces.push_back(remaining);
-
   for (auto &part : replace_parts)
     if (part.type == ReplacePart::PartType::Constant)
       Shard::release(std::get<Shard *>(part.value));
-
   std::vector<Shard *> compact;
   compact.reserve(pieces.size());
   for (Shard *p : pieces) {
@@ -154,14 +166,15 @@ Shard *substitute(
     else if (p)
       Shard::release(p);
   }
-
   Shard *new_root = compact.empty() ? nullptr : Shard::build(compact.data(), 0, compact.size());
   Shard::release(root);
   return new_root;
 }
 
 uint64_t find_next(Shard *root, std::string_view pattern, uint64_t start) {
-  if (start == 0 || start > root->lines)
+  if (!root)
+    throw ed_error("Invalid line number.");
+  if (start == 0 || start > root->lines + 1)
     throw ed_error("Invalid line number.");
   start--;
   std::vector<RegexMatch> results;
@@ -190,7 +203,7 @@ uint64_t find_next(Shard *root, std::string_view pattern, uint64_t start) {
     if (rc >= 0) {
       pcre2_match_data_free(match_data);
       pcre2_code_free(re);
-      return at;
+      return at + 1;
     }
     if (rc != PCRE2_ERROR_NOMATCH) {
       pcre2_match_data_free(match_data);
@@ -208,7 +221,7 @@ uint64_t find_next(Shard *root, std::string_view pattern, uint64_t start) {
     if (rc >= 0) {
       pcre2_match_data_free(match_data);
       pcre2_code_free(re);
-      return at;
+      return at + 1;
     }
     if (rc != PCRE2_ERROR_NOMATCH) {
       pcre2_match_data_free(match_data);
@@ -223,7 +236,9 @@ uint64_t find_next(Shard *root, std::string_view pattern, uint64_t start) {
 }
 
 uint64_t find_prev(Shard *root, std::string_view pattern, uint64_t start) {
-  if (start == 0 || start > root->lines)
+  if (!root)
+    throw ed_error("Invalid line number.");
+  if (start == 0 || start > root->lines + 1)
     throw ed_error("Invalid line number.");
   start--;
   std::vector<RegexMatch> results;
@@ -252,7 +267,7 @@ uint64_t find_prev(Shard *root, std::string_view pattern, uint64_t start) {
     if (rc >= 0) {
       pcre2_match_data_free(match_data);
       pcre2_code_free(re);
-      return at;
+      return at + 1;
     }
     if (rc != PCRE2_ERROR_NOMATCH) {
       pcre2_match_data_free(match_data);
@@ -270,7 +285,7 @@ uint64_t find_prev(Shard *root, std::string_view pattern, uint64_t start) {
     if (rc >= 0) {
       pcre2_match_data_free(match_data);
       pcre2_code_free(re);
-      return at;
+      return at + 1;
     }
     if (rc != PCRE2_ERROR_NOMATCH) {
       pcre2_match_data_free(match_data);

src/internal/vase/regex/core.cc

@@ -64,7 +64,7 @@ std::vector<RegexMatch> _regex_search(
   uint64_t offset = UINT64_MAX;
 
   auto record_match = [&](int rc, PCRE2_SIZE *ovector) {
-    if (global_offset + (uint64_t)ovector[1] > end_offset || ovector[0] == ovector[1])
+    if (global_offset + (uint64_t)ovector[1] > end_offset)
       return;
     RegexMatch match{
       .start = global_offset + (uint64_t)ovector[0],
@@ -74,8 +74,8 @@ std::vector<RegexMatch> _regex_search(
       PCRE2_SIZE s = ovector[2 * i];
       PCRE2_SIZE e = ovector[2 * i + 1];
       if (s != PCRE2_UNSET) {
-        match.groups[i].start = global_offset + (uint64_t)s;
-        match.groups[i].end = global_offset + (uint64_t)e;
+        match.groups[i - 1].start = global_offset + (uint64_t)s;
+        match.groups[i - 1].end = global_offset + (uint64_t)e;
       }
     }
     results.push_back(std::move(match));

src/internal/vase/shard.cc

@@ -1,3 +1,4 @@
+#include "internal/io/io.h"
 #include "internal/vase/vase.h"
 
 namespace bed::internal::vase {
@@ -192,25 +193,27 @@ Shard *Shard::append(Shard *root, Shard *leaf) {
 Shard *Shard::build(Shard **pieces, uint64_t lo, uint64_t hi) {
   if (hi - lo == 1)
     return pieces[lo];
-  size_t mid = lo + (hi - lo) / 2;
+  uint64_t mid = lo + (hi - lo) / 2;
   Shard *left = build(pieces, lo, mid);
   Shard *right = build(pieces, mid, hi);
-  Shard *node = new Branch(left, right);
+  Shard *node = Shard::concat(left, right);
   Shard::release(left);
   Shard::release(right);
   return node;
 }
 
-Shard *Shard::from_command(const char *cmd, bool posix_ending) {
+Shard *Shard::from_command(const char *cmd) {
   auto o = new OriginalStorage("/tmp");
   int dest_fd = o->fd;
   if (dest_fd == -1) {
     delete o;
     return nullptr;
   }
+  io::IO::cleanup();
   FILE *pipe = popen(cmd, "r");
   if (!pipe) {
     delete o;
+    io::IO::enable_raw();
     return nullptr;
   }
   std::vector<Shard *> pieces;
@@ -245,6 +248,7 @@ Shard *Shard::from_command(const char *cmd, bool posix_ending) {
       if (!write_all(dest_fd, buf, buf_cursor)) {
         pclose(pipe);
         delete o;
+        io::IO::enable_raw();
         return nullptr;
       }
       pieces.push_back(new Petal(buf_cursor, lines, o, pos));
@@ -254,23 +258,26 @@ Shard *Shard::from_command(const char *cmd, bool posix_ending) {
       break;
     if (ferror(pipe)) {
       delete o;
+      io::IO::enable_raw();
       return nullptr;
     }
   }
   int status = pclose(pipe);
   if (status == -1) {
     delete o;
+    io::IO::enable_raw();
     return nullptr;
   }
   if (!WIFEXITED(status) || WEXITSTATUS(status) != 0) {
     delete o;
+    io::IO::enable_raw();
     return nullptr;
   }
   if (pieces.empty()) {
     delete o;
+    io::IO::enable_raw();
     return nullptr;
   }
-  if (posix_ending) {
   if (ending[1] == '\n') {
     Petal *last = (Petal *)pieces.back();
     last->lines--;
@@ -281,18 +288,20 @@ Shard *Shard::from_command(const char *cmd, bool posix_ending) {
       last = nullptr;
       if (!pieces.empty())
         last = (Petal *)pieces.back();
+      else
+        return nullptr;
     }
     if (last && ending[0] == '\r')
       last->length--;
   }
-  }
   o->initialize();
+  io::IO::enable_raw();
   if (pieces.size() == 1)
     return pieces[0];
   return build(pieces.data(), 0, pieces.size());
 }
 
-Shard *Shard::from_file(const std::filesystem::path &path, bool posix_ending) {
+Shard *Shard::from_file(const std::filesystem::path &path) {
   auto o = new OriginalStorage("/tmp");
   int dest_fd = o->fd;
   if (dest_fd == -1) {
@@ -302,10 +311,10 @@ Shard *Shard::from_file(const std::filesystem::path &path, bool posix_ending) {
   int src_fd = open(path.c_str(), O_RDONLY);
   if (src_fd == -1) {
     delete o;
-    return nullptr;
+    throw ed_error("Couldn't open file.");
   }
   uint64_t total = std::filesystem::file_size(path);
-  if (posix_ending && total > 0) {
+  if (total > 0) {
     char last;
     if (pread(src_fd, &last, 1, (off_t)(total - 1)) != 1) {
       delete o;
@@ -370,7 +379,7 @@ Shard *Shard::from_file(const std::filesystem::path &path, bool posix_ending) {
   return build(pieces.data(), 0, pieces.size());
 }
 
-Shard *Shard::from_string(const char *data, uint64_t len, bool posix_ending) {
+Shard *Shard::from_string(const char *data, uint64_t len) {
   auto o = new OriginalStorage("/tmp");
   int dest_fd = o->fd;
   if (dest_fd == -1 || data == nullptr) {
@@ -378,7 +387,7 @@ Shard *Shard::from_string(const char *data, uint64_t len, bool posix_ending) {
     return nullptr;
   }
   uint64_t total = len;
-  if (posix_ending && total > 0) {
+  if (total > 0) {
     if (data[total - 1] == '\n') {
       total--;
       if (total > 0 && data[total - 1] == '\r')
@@ -421,54 +430,4 @@ Shard *Shard::from_string(const char *data, uint64_t len, bool posix_ending) {
     return pieces[0];
   return build(pieces.data(), 0, pieces.size());
 }
-
-void Shard::dump(Shard *node, int depth) {
-  if (!node) {
-    std::cout << std::string(depth * 2, ' ') << "<null>\n";
-    return;
-  }
-  std::string indent(depth * 2, ' ');
-  std::cout << indent
-            << "Shard@" << node
-            << " kind=";
-  switch (node->kind) {
-  case Shard::Kind::Branch:
-    std::cout << "Branch";
-    break;
-  case Shard::Kind::Petal:
-    std::cout << "Petal";
-    break;
-  }
-  std::cout
-    << " height=" << unsigned(node->height)
-    << " length=" << node->length
-    << " lines=" << node->lines
-    << " refs=" << node->refs.load()
-    << "\n";
-  if (node->kind == Shard::Kind::Branch) {
-    auto *branch = (Branch *)node;
-    std::cout << indent << "  left:\n";
-    dump(branch->left, depth + 2);
-    std::cout << indent << "  right:\n";
-    dump(branch->right, depth + 2);
-  } else {
-    auto *petal = static_cast<Petal *>(node);
-    constexpr auto clean = [](const std::string &text) {
-      std::string result = text;
-      size_t pos = 0;
-      while ((pos = result.find('\n', pos)) != std::string::npos) {
-        result.replace(pos, 1, "\\n");
-        pos += 2;
-      }
-      return result;
-    };
-    std::cout
-      << indent << "  source=" << petal->source
-      << " pos=" << petal->pos
-      << " length=" << petal->length
-      << " lines=" << petal->lines
-      << " text=\"" << clean(std::string(petal->source->read(petal->pos), petal->length))
-      << "\"\n";
-  }
-}
 } // namespace bed::internal::vase

src/internal/vase/vase.cc

@@ -1,4 +1,5 @@
 #include "internal/vase/vase.h"
+#include "internal/io/io.h"
 
 namespace bed::internal::vase {
 std::string to_string(Shard *root) {
@@ -73,14 +74,7 @@ void _insert(AppendStorage *ap, Shard **root, Point *point, const char *data, ui
     ++lines;
     last_line = ++data;
   }
-  uint64_t col = 0;
-  uint64_t remaining = end - last_line;
-  while (remaining) {
-    uint64_t n = grapheme_next_character_break_utf8(last_line, remaining);
-    last_line += n;
-    remaining -= n;
-    ++col;
-  }
+  uint64_t col = end - last_line;
   if (lines) {
     point->row += lines;
     point->col = col;
@@ -121,6 +115,22 @@ Shard *replace(AppendStorage *ap, Shard *root, Range range, const char *data, ui
   return insert(ap, root, &range.start, data, len);
 }
 
+Point eof_point(Shard *root) {
+  if (!root)
+    return {0, 0};
+  Point result{
+    .row = root->lines,
+    .col = 0
+  };
+  PetalIterator it(root, Direction::Forward);
+  it.seek_line(root->lines);
+  const char *data;
+  uint64_t len;
+  while (it.next(&data, &len))
+    result.col += len;
+  return result;
+}
+
 uint64_t offset_of(Shard *root, Point point) {
   return offset_of(root, point.row) + point.col;
 }
@@ -128,7 +138,11 @@ uint64_t offset_of(Shard *root, Point point) {
 uint64_t offset_of(Shard *root, uint64_t line) {
   if (!root)
     return 0;
-  if (line > root->lines)
+  if (line == 0)
+    return 0;
+  if (line == root->lines + 1)
+    return root->length;
+  if (line > root->lines + 1)
     throw ed_error("line out of range");
   uint64_t offset = 0;
   Shard *curr = root;
@@ -196,7 +210,7 @@ Shard *insert(AppendStorage *ap, Shard *root, Shard *text, uint64_t line) {
   return result;
 }
 
-Shard *erase(Shard *root, uint64_t start, uint64_t end) {
+Shard *replace(Shard *root, Shard *text, uint64_t start, uint64_t end) {
   if (!start || !end)
     throw ed_error("Invalid range.");
   start--;
@@ -210,7 +224,34 @@ Shard *erase(Shard *root, uint64_t start, uint64_t end) {
   uint64_t end_offset =
     (end + 1 == line_count)
       ? root->length
-      : offset_of(root, end + 1);
+      : offset_of(root, end + 1) - 1;
+  auto [left, rest] = Shard::split(root, start_offset);
+  auto [middle, right] = Shard::split(rest, end_offset - start_offset);
+  Shard *a = Shard::concat(left, text);
+  Shard *new_root = Shard::concat(a, right);
+  Shard::release(left);
+  Shard::release(rest);
+  Shard::release(middle);
+  Shard::release(right);
+  Shard::release(a);
+  Shard::release(root);
+  return new_root;
+}
+
+Shard *erase(Shard *root, uint64_t start, uint64_t end) {
+  if (!start || !end)
+    throw ed_error("Invalid range.");
+  start--;
+  end--;
+  if (!root)
+    throw ed_error("line range out of bounds");
+  uint64_t line_count = root->lines + 1;
+  if (start > end || end >= line_count)
+    throw ed_error("line range out of bounds");
+  uint64_t start_offset = offset_of(root, start);
+  uint64_t end_offset = offset_of(root, end + 1);
+  if (end == root->lines && start_offset)
+    start_offset--;
   auto [left, rest] = Shard::split(root, start_offset);
   auto [middle, right] = Shard::split(rest, end_offset - start_offset);
   Shard *new_root = Shard::concat(left, right);
@@ -222,6 +263,37 @@ Shard *erase(Shard *root, uint64_t start, uint64_t end) {
   return new_root;
 }
 
+Shard *join(Shard *root, uint64_t start, uint64_t end) {
+  if (!start || !end)
+    throw ed_error("Invalid range.");
+  start--;
+  end--;
+  if (!root)
+    throw ed_error("line range out of bounds");
+  uint64_t line_count = root->lines + 1;
+  if (start >= end || end >= line_count)
+    throw ed_error("line range out of bounds");
+  uint64_t offset = offset_of(root, start);
+  std::vector<Shard *> pieces;
+  pieces.reserve(end - start + 3);
+  auto [a, b] = Shard::split(root, offset);
+  pieces.push_back(a);
+  for (uint64_t line = start; line < end; line++) {
+    uint64_t nl_pos = offset_of(b, 1) - 1;
+    auto [content, rest] = Shard::split(b, nl_pos);
+    Shard::release(b);
+    auto [nl, next_b] = Shard::split(rest, 1);
+    Shard::release(rest);
+    Shard::release(nl);
+    pieces.push_back(content);
+    b = next_b;
+  }
+  pieces.push_back(b);
+  Shard *joined = Shard::build(pieces.data(), 0, pieces.size());
+  Shard::release(root);
+  return joined;
+}
+
 Shard *copy(Shard *root, uint64_t start, uint64_t end) {
   if (!start || !end)
     throw ed_error("Invalid range.");
@@ -236,13 +308,57 @@ Shard *copy(Shard *root, uint64_t start, uint64_t end) {
   uint64_t end_offset =
     (end + 1 == line_count)
       ? root->length
-      : offset_of(root, end + 1);
+      : offset_of(root, end + 1) - 1;
   auto [left, rest] = Shard::split(root, start_offset);
   auto [middle, right] = Shard::split(rest, end_offset - start_offset);
   Shard::release(left);
   Shard::release(rest);
   Shard::release(right);
-  Shard::release(root);
   return middle;
 }
+
+void write_file(std::filesystem::path path, Shard *text) {
+  std::ofstream file(path, std::ios::binary);
+  if (!text)
+    return;
+  PetalIterator it(text, Direction::Forward);
+  it.seek_offset(0);
+  const char *data;
+  uint64_t len;
+  while (it.next(&data, &len)) {
+    if (!file)
+      throw ed_error("Failed while writing file: " + path.string());
+    file.write(data, len);
+  }
+  file.write("\n", 1);
+  if (!file)
+    throw ed_error("Failed while writing file: " + path.string());
+}
+
+void write_command(const char *cmd, Shard *text) {
+  io::IO::cleanup();
+  FILE *pipe = popen(cmd, "w");
+  if (!pipe) {
+    io::IO::enable_raw();
+    throw ed_error("Failed to start command: " + std::string(cmd));
+  }
+  if (!text) {
+    int status = pclose(pipe);
+    if (status == -1)
+      throw ed_error("Failed to wait for command: " + std::string(cmd));
+    return;
+  }
+  PetalIterator it(text, Direction::Forward);
+  it.seek_offset(0);
+  const char *data;
+  uint64_t len;
+  while (it.next(&data, &len))
+    fwrite(data, 1, len, pipe);
+  fwrite("\n", 1, 1, pipe);
+  int status = pclose(pipe);
+  io::IO::enable_raw();
+  if (status == -1)
+    throw ed_error("Failed to wait for command: " + std::string(cmd));
+  return;
+}
 } // namespace bed::internal::vase

src/main.cc

@@ -4,17 +4,16 @@
 int main(int argc, char *argv[]) {
   std::vector<std::string> args(argv, argv + argc);
   try {
-    bed::internal::io::IO io = bed::internal::io::IO();
-    bed::BEd ed(args, io);
+    bed::BEd ed(args);
     ed.run();
   } catch (bed::fatal_error &e) {
     if (e.code)
-      std::cout << "Fatal error: " << e.what() << std::endl;
+      printf("Fatal error: %s\n", e.what());
     return e.code;
   }
 #ifndef DEBUG
   catch (...) {
-    std::cout << "Unexpected error." << std::endl;
+    printf("Unexpected error.\n");
     return 1;
   }
 #endif