"Reliability, speed, cost in that order. It accounts for 90% of our actionable leads and 85% of our revenue. The cost is not material compared to the business impact. ZenRows gives us the reliability we need when data sources try to block us out."
Challenge: Real Estate Lead Generation Under Threat
Our customer is a leading Swiss real estate brokerage that generates 85% of its revenue from property leads generated across 12+ marketplaces. When key platforms deployed advanced anti-bot measures, their real estate lead generation tool began experiencing frequent failures, directly threatening their core revenue stream. The engineering team was spending 30+ hours weekly maintaining scrapers and troubleshooting blocked requests. With their business model at risk, the team needed a solution that could ensure consistent data access without overwhelming their technical resources.
The brokerage had built what it thought was a formidable scraper, bringing in millions of dollars in MRR. But surprises are inevitable with anti-bot measures. Primary data sources updated their firewall. And the company's in-house crawlers, which were its leads and revenue generation engine, stopped amid stiff anti-scraping measures.
"It used to be the most stable part of the business... then all hell broke loose. Without the crawler, we don't have actionable sales objects, and we make no revenue," says the company's CTO.
This unforeseen situation not only halted their data pipeline but also resulted in the following technical and business setbacks:
- Sudden disruption in business operations: Advanced anti-bot measures from providers like Cloudflare and Vercel started blocking their C# crawler without warning, causing significant interruptions to core lead-generation activities.
- Major data outages: During protection updates, they experienced a complete loss of data volume for up to 3 consecutive days, directly impacting their ability to acquire new leads.
- Reactive and manual block detection: The team relied on manual monitoring of data volumes to detect when blocks occur, resulting in delayed response times and prolonged downtime.
- Performance challenges: To maintain a competitive edge, the crawler must deliver results with a maximum response time of 120ms. This target became increasingly difficult to meet under the current conditions.
- Revenue loss: 90% of actionable leads and 85% of total company revenue depended on the reliability of the crawler. The sudden disruption resulted in a significant loss in MRR.
- Significant engineering overhead: The engineering team started dedicating over 30 hours per week solely to crawler maintenance and troubleshooting, diverting resources from strategic initiatives.
- Inability to cope with peak season: Seasonal increases in anti-bot protection, particularly leading up to the critical September peak, posed an escalating threat to business continuity and revenue targets.
The Solution: Protecting Real Estate Lead Generation with Anti-Bot Web Scraping
The brokerage company reached out to ZenRows to revive its failing crawler infrastructure. By Fall 2024, they had initiated a proof of concept with ZenRows and moved to full production by January 2025. The team integrated their Python crawler with the ZenRows Universal Scraper API and embedded it into their existing Node.js → Azure → Salesforce pipeline.
Initial response time challenges under high-volume requests were resolved by optimizing the ZenRows integration and developing custom scripts. This ensured the system met performance expectations. Today, this hybrid setup handles 50% of the team's crawling needs for their most critical and protected sites, with their C# crawler handling bulk collection from less protected sources.
"We've created the second crawler, which works with ZenRows, and that's the one that gets through more of these high-value sites."
ZenRows' reliable anti-bot bypass solution, featuring JavaScript rendering, a vast premium proxy network, and an auto-managed and auto-scaled architecture, brought massive relief to the company's engineering team. They now divert significant engineering time to more profitable business initiatives rather than maintaining frequently breaking scrapers.
Learn more about web scraping for real estate with ZenRows.
Results: Our Client Restores 90% of Leads and 85%+ Revenue with ZenRows
By integrating ZenRows into their existing data pipeline, our customer restored reliable access to critical property listings while dramatically reducing maintenance overhead to under 10 hours per week. Their hybrid infrastructure now processes 4,000 daily records, consistently generating 250+ qualified leads that translate to millions in annual revenue
As a result, the company restored access to 90% of its actionable leads and safeguarded over 85% of its total revenue, reversing the losses caused by crawler failures.
With ZenRows, the real estate company now maintains consistent access to high-value targets and is positioned for future scalability across European markets.
Sustained Lead Flow, Reduced Overhead, and New Opportunities
The company's integration with ZenRows delivered significant operational improvements and strategic value:
- Lead generation soared: Besides restoring 90% lead generation, they maintained a consistent flow of 250 qualified leads daily, even during major protection updates.
- Improved operational efficiency: The team reduced crawler maintenance from 30 hours to under 10 hours per week (67% reduction).
- System optimization: The company now evenly splits crawling tasks, with 50% handled by ZenRows for protected sites and 50% by internal systems for less protected sources. This achievement maximizes reliability and efficiency.\
- Revenue protection: They experience zero revenue loss during Cloudflare and Vercel protection rollouts. The initial 85% total revenue loss risk was also reversed.
- Team focus: Engineering resources are redirected from maintenance to core machine learning and AI development.
- Expanded market access: The team secured reliable lead capture from new Italian-speaking markets.
- Seasonal readiness: They gained enhanced capability to handle September's traditional protection challenges.
- Growth foundation: The engineering team established scalable infrastructure supporting planned European expansion.
"We have no intention of moving away from ZenRows. In fact, as long as we can maintain the necessary data volume, we plan to rely on ZenRows even more in the future."
Interested in finding out more? Then read our blog on the 7 Proven Ways to Generate Real Estate Leads.
Key Takeaways
- Proactively monitor competitor protection patterns to stay ahead of disruptions.
- Combine internal speed with external reliability for the best performance.
- Always maintain backup systems for mission-critical processes.
- Focus initial efforts on high-value, highly protected sites for maximum business impact.
- Integrate new solutions gradually to minimize operational risk.
Why ZenRows is the Best Tool for Real Estate Lead Generation
When online property marketplaces tighten anti-bot protections, custom crawlers often break, leading to lost leads and revenue. ZenRows solves this with enterprise-grade anti-bot bypass, premium proxies, and automated scaling, keeping data pipelines running smoothly. ZenRows transforms fragile web scraping systems into a stable, scalable engine for fast, reliable, and consistent lead generation. Capture thousands of listings daily, generate qualified leads, and safeguard your revenue with us.
Ready to transform your sales pipeline into a sustainable revenue stream like this real-estate brokerage?
Contact Sales or sign up to give ZenRows a try.