13 lines
1.2 KiB
Markdown
13 lines
1.2 KiB
Markdown
# Some Python scripts
|
|
## Web scraping
|
|
This was a personal-use "web spiders" to help me on certain goals such as seeking a new flat with specific characteristics or getting a massive list of edonkey links from a web page.
|
|
<br>
|
|
I've chosen **Python** due to the complete libraries suite for web scrapping that it offers, and the ease of using them. <br>
|
|
But of course, since it's not my main language nor workspace the code quality and design are very poor.
|
|
### Flat search
|
|
Some time ago, the real state agents fees were paid by the leaseholder, and find a flat rental comming directly from the owner meant saving a lot of money, but this was very hard to find, because the common web platforms only contained real state ads.<br>
|
|
This homemade web spider helped me on finding these exceptional deals.
|
|
### Link capturer
|
|
I've also developed one web spider that capture all the eDonkey links from a web-page so that I could copy them to a downloader manager
|
|
## Other tools
|
|
I have here also a multi-threading HTTP GET requests script, that can be used to test the performance of a system under a certain load of concurrency requests. The purpose of its development was to have a metric of reference and later improve the performance. |