zoorpha_rustshare-obsidian-.../node_modules/js-tokens
2026-06-15 12:19:23 +02:00
..
index.d.ts rustshare obsidian plugin 2026-06-15 12:19:23 +02:00
index.js rustshare obsidian plugin 2026-06-15 12:19:23 +02:00
LICENSE rustshare obsidian plugin 2026-06-15 12:19:23 +02:00
package.json rustshare obsidian plugin 2026-06-15 12:19:23 +02:00
README.md rustshare obsidian plugin 2026-06-15 12:19:23 +02:00

js-tokens

The tiny, regex powered, lenient, almost spec-compliant JavaScript tokenizer that never fails.

import jsTokens from "js-tokens";

const jsString = 'JSON.stringify({k:3.14**2}, null /*replacer*/, "\\t")';

Array.from(jsTokens(jsString), (token) => token.value).join("|");
// JSON|.|stringify|(|{|k|:|3.14|**|2|}|,| |null| |/*replacer*/|,| |"\t"|)

➡️ Full readme