projects / tweeper.git / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: ae19a2f) | patch
src/Tweeper.php: set User-Agent to impersonate a Google crawler
authorAntonio Ospite <ao2@ao2.it>
Thu, 24 Dec 2020 09:04:59 +0000 (10:04 +0100)
committerAntonio Ospite <ao2@ao2.it>
Thu, 24 Dec 2020 09:04:59 +0000 (10:04 +0100)
commit357d7a4955830d690a16d52a6f91e351c813ab48
tree95921b61100aab7ea6b2ca2771b2de850fe2603btree | snapshot
parentae19a2f4361fbac5cd4d393291c6c088265e9647commit | diff
src/Tweeper.php: set User-Agent to impersonate a Google crawler

Set User-Agent to impersonate a Google crawler, this makes twitter.com
return the old desktop UI which can be more easily scraped.

This restore brings back support for twitter.com which has stopped
serving the mobile UI which was still scrapeable somehow.
src/Tweeper.php diff | blob | history
A web scraper to convert supported websites, like Twitter.com, to RSS