Notes & Experiments
Observations, tools, and small projects about how the web behaves in practice.
Data ExtractionNDJSONNode.jsProxy RotationPuppeteerScraperAPITravelWeb ScrapingWebshareXOR Encryptionbehaviorfrictionlinksobservationplatforms
•4 min read
Not every place on the web is meant for sharing
There are places online where sharing content feels natural. And then there are places where sharing feels off — not because the content is wrong, but because the environment wasn't built to receive it.
frictionlinksbehaviorplatformsobservation
DEDigital Evenings
•14 min read
Extracting 21,000+ Travel Advisor Profiles: A High-Performance Scraper
Built a production-ready Node.js scraper that extracts comprehensive profiles for 21,000+ travel advisors from a travel advisory platform using proxy rotation, caching, and concurrent processing with streaming NDJSON output.
Web ScrapingNode.jsProxy RotationData ExtractionTravelNDJSONWebshare
DEDigital Evenings
•12 min read
Extracting 1,155+ Cruise Ships: A Complete Data Scraper
Built a production-ready Node.js scraper that extracts comprehensive data for 1,155+ cruise ships including specifications, amenities, images, and details from Ody's booking platform using Puppeteer and ScraperAPI.
Web ScrapingNode.jsPuppeteerScraperAPIData ExtractionTravelXOR Encryption
DEDigital Evenings
•10 min read
Scraping 900+ Cruise Ship Editor Reviews at Scale
Built a Node.js scraper that extracts editor reviews for ~900 cruise ships. Covers overview, dining, activities, and cabins sections using ScraperAPI with concurrent scraping, caching, and auto-resume.
Web ScrapingNode.jsScraperAPIData ExtractionTravel
DEDigital Evenings