Hi,
We try to download all the following files present in the site http://ftp.ebi.ac.uk using Python :
- /pub/databases/opentargets/genetics/latest/d2v2g/
- /pub/databases/opentargets/genetics/latest/l2g/
- /pub/databases/opentargets/genetics/latest/search/variant/
but, we couldn’t download all the files all at once.
Here is what happens:
- The download of the files /pub/databases/opentargets/genetics/latest/d2v2g/ goes well until the file “part-00182-5fc32108-15fe-418e-9e53-52afa7c58284-c000.snappy.parquet”, and the script stops here (duration of the download : 1h57mn).
- If I stop the script, and retry the download, the following error occurred : “Connection timed out”
- If I wait 1 hour, and retry, the download of the files could continue. This time, I could download all the files of /pub/databases/opentargets/genetics/latest/l2g/ , and the files /pub/databases/opentargets/genetics/latest/search/variant/ up to “part-00033-867067f5-71c7-4946-bf6b-b1125d25951f-c000.json” (duration of the download : 49mn)
- Once again the download stops here
Thus, I would like to know what is happening. Were we temporarily blocked ? Are there any restrictions about the download of files ? In particular, is there a restriction about the number of downloads that can be done on a certain period of time ?
If this is the case, are there any way to download these files all at once ?
Thank you very much,
Kind regards