xavier
/
PythonScripts
1
0
Fork 0
Code

better explanation of the contents

This commit is contained in:
Xavier Fontanet 2024-07-10 18:27:24 +02:00
parent f7ee3b8a16
commit caf9fead83
1 changed files with 12 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

13
README.md
View File

@ -1,4 +1,13 @@
# Some Web Scrapping tools # Some Python scripts
This was a personal-use util software to help me on certain goals such as seeking a new flat with specific characteristics or getting a massive list of edonkey links from a web page.<br> ## Web scraping
This was a personal-use "web spiders" to help me on certain goals such as seeking a new flat with specific characteristics or getting a massive list of edonkey links from a web page.
<br>
I've chosen **Python** due to the complete libraries suite for web scrapping that it offers, and the ease of using them. <br> I've chosen **Python** due to the complete libraries suite for web scrapping that it offers, and the ease of using them. <br>
But of course, since it's not my main language nor workspace the code quality and design are very poor. But of course, since it's not my main language nor workspace the code quality and design are very poor.
### Flat search
Some time ago, the real state agents fees were paid by the leaseholder, and find a flat rental comming directly from the owner meant saving a lot of money, but this was very hard to find, because the common web platforms only contained real state ads.<br>
This homemade web spider helped me on finding these exceptional deals.
### Link capturer
I've also developed one web spider that capture all the eDonkey links from a web-page so that I could copy them to a downloader manager
## Other tools
I have here also a multi-threading HTTP GET requests script, that can be used to test the performance of a system under a certain load of concurrency requests. The purpose of its development was to have a metric of reference and later improve the performance.