Convert public web pages into clean Markdown with markdown.new for AI workflows. Use when tasks require URL-to-Markdown conversion for summarization, RAG ing...
Install
Documentation
Markdown.new
Use this skill to convert public URLs into LLM-ready Markdown via [markdown.new](https://markdown.new).
Path Resolution (Critical)
- -Resolve relative paths like
scripts/...andreferences/...from the skill directory, not workspace root. - -If current directory is unknown, use an absolute script path.
python3 ~/.codex/skills/markdown-new/scripts/markdown_new_fetch.py 'https://example.com'
cd ~/.codex/skills/markdown-new
python3 scripts/markdown_new_fetch.py 'https://example.com'
Avoid this pattern from an arbitrary workspace root:
python3 scripts/markdown_new_fetch.py 'https://example.com'
Workflow
1. Validate the input URL is public http or https.
2. Run scripts/markdown_new_fetch.py with --method auto first.
3. Re-run with --method browser if output misses JS-rendered content.
4. Enable --retain-images only when image links are required.
5. Capture response metadata (x-markdown-tokens, x-rate-limit-remaining, and JSON metadata when present) for downstream planning.
Quick Start
Commands below assume current directory is the skill root (~/.codex/skills/markdown-new).
python3 scripts/markdown_new_fetch.py 'https://example.com' > page.md
python3 scripts/markdown_new_fetch.py 'https://example.com' --method browser --retain-images --output page.md
python3 scripts/markdown_new_fetch.py 'https://example.com' --deliver-md
Method Selection
- -
auto: default. Let markdown.new use its fastest successful pipeline. - -
ai: force Workers AI HTML-to-Markdown conversion. - -
browser: force headless browser rendering for JS-heavy pages.
Use auto first, then retry with browser only when needed.
Delivery Mode
- -Use
--deliver-mdto force file output in.mdformat. - -In delivery mode, content is wrapped as:
<url>
- ...markdown...
- </url>
- -If
--outputis omitted, the script auto-generates a filename from the URL.
API Modes
- -Prefix mode:
https://markdown.new/https://example.com?method=browser&retain_images=true
- -POST mode:
POST https://markdown.new/
- JSON body: {"url":"https://example.com","method":"auto","retain_images":false}
Prefer POST mode for automation and explicit parameters.
Limits And Safety
- -Treat
429as rate limiting (documented limit: 500 requests/day/IP). - -Convert only publicly accessible pages.
- -Respect
robots.txt, terms of service, and copyright constraints. - -Do not treat markdown.new output as guaranteed complete for every page; verify critical extractions.
References
- -
references/markdown-new-api.md
Launch an agent with Markdown.new Skill on Termo.