Blog

2 posts, continuously updated

Architecture Trade-offs 2 Engineering Decisions 1 Long-term Maintenance 1 Solo Projects 1 Crawler Engineering 1 Next.js 1 ISR 1 Caching 1 Rendering 1 Content Engineering 1

January 1, 2026 4 min read

From Scrapy to Custom: Engineering Trade-offs in a Solo Long-Term Crawler Project

For solo long-term projects, engineering challenges are rarely about what’s possible, but about what remains sustainable over time. This article reflects on the engineering risks I encountered while using Scrapy and explains why I ultimately chose to build a custom crawler framework—not as an upgrade, but as a deliberate redistribution of engineering risk.
- Engineering Decisions
- Architecture Trade-offs
- Long-term Maintenance
- Solo Projects
- Crawler Engineering
→

December 31, 2025 10 min read

The True Behavior and Design Tradeoffs of ISR in Next.js App Router: Why Your Pages Aren't Updating

Deconstructing how ISR truly works in the Next.js App Router to clarify the root cause of 'why pages don't update despite data changes.' Understand ISR's design assumptions, latency, and inherent inconsistencies from a content-driven site perspective. Discuss when to continue using ISR versus transitioning to on-demand revalidate based on real-world operational rhythms.
- Next.js
- ISR
- Caching
- Rendering
- Content Engineering
- Architecture Trade-offs
→

Blog

From Scrapy to Custom: Engineering Trade-offs in a Solo Long-Term Crawler Project

The True Behavior and Design Tradeoffs of ISR in Next.js App Router: Why Your Pages Aren't Updating