crwlr.software

😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈😈

Made it to 10,000 installs of the crwlr/crawler package! 🥳💪🏻
Here’s to the next 10,000! 🥂

Reached some install milestones for the crwlr packages 🎉
- url passed 50,000 installs
- query-string is at an unbelievable 3,000,000 installs (thanks to bref!)
- robots-txt is approaching 15,000
- crawler will soon reach 10,000

Thanks to everyone using and supporting the packages! 🫶

GitHub - crwlrsoft/crawler: Library for Rapid (Web) Crawler and Scraper Development Library for Rapid (Web) Crawler and Scraper Development - crwlrsoft/crawler

Made it to 350 ⭐️s on the crawler package Github repo! 🚀💪🏻🫶
github.com/crwlrsoft/cr...

Tagged a bugfix release of the robots-txt package, thx to this issue github.com/crwlrsoft/ro... by Martin-Matchory. 🙏💪🏻

Crwlr Recipes: Using a Crawler for Website Error Detection and Cache Warming Have you ever deployed your website or web app, only to discover hours later that you’ve introduced bugs or broken links? Or do you clear the cache with every deploy, leaving the first users to experi...

A new blog article is out! 🤓📚

Learn how to use a crawler to perform a health check and warm your cache after every deployment of your website or web app. Ensure smooth performance and error-free user experiences. Happy reading!

www.crwlr.software/blog/post-de...

symfony/src/Symfony/Component/DomCrawler/NativeCrawler/DomCrawler.php at 10667d5382b4dc2e4078d6408f92f34ffd52b580 · symfony/symfony The Symfony PHP framework. Contribute to symfony/symfony development by creating an account on GitHub.

Wait, I think I was wrong and there is still an XPath option! See github.com/symfony/symf...
from github.com/symfony/symf...

Ah, great insight 👍 thx!

Yeah, maybe also because it'd be a lot more work implementing both and CSS selectors are easier and more popular.
I know that Symfony translates CSS selectors to XPath under the hood, because CSS selectors weren't available natively. Using CSS selectors instead is definitely the better choice!

CSS Selectors 🙂
wiki.php.net/rfc/dom_addi...

Ah, it seems like XPath is no longer an option in the new DOM API in PHP 8.4. I assume it won’t be a problem if we remove this feature in a new major version of the crwlr/crawler library?

The new HTML5/DOM functionality in PHP 8.4 is amazing! I’m working on adding it to crwlr/crawler to leverage it when PHP 8.4 is used. This will enable features like CSS pseudo-selectors not supported by Symfony DomCrawler.

PHP 8.4 Released PHP 8.4 is a major update of the PHP language. It contains many new features, such as property hooks, asymmetric visibility, an updated DOM API, performance improvements, bug fixes, and general cleanu...

PHP 8.4 just dropped! 🥳🚀💪
php.net/releases/8.4...
Great release page! Well done!

Already added running tests on 8.4 in CI, so all crwlr packages should be ready for the upgrade! 💪🙂

Hey Bluesky! 👋
What better time to move over from the old place? So, crwlr is now here on Bluesky too! 🥳🚀