The Movie Database Support

For a school project I am making around 10000000 requests (I know it's a lot but I need revenue data for all movies in the IMDB CSV dump). I have max 19 simultaneous open connections and have implemented a system that doesn't make more than 40 requests per second.

After about 8000 requests, I get a timeout from the server (an actual timeout, not a 503-error). I've tried this on 2 PC's and I have this issue on both pc's.

Is this some kind of rate-limit that I am reaching, or is there a different reason?

1 reply (on page 1 of 1)

Jump to last post

Hi @marnick,

There's no other block than the rate limiting. Probably best to just retry and continue on timeouts and or other errors you might come across.

Can't find a movie or TV show? Login to create it.

Global

s focus the search bar
p open profile menu
esc close an open window
? open keyboard shortcut window

On media pages

b go back (or to parent when applicable)
e go to edit page

On TV season pages

(right arrow) go to next season
(left arrow) go to previous season

On TV episode pages

(right arrow) go to next episode
(left arrow) go to previous episode

On all image pages

a open add image window

On all edit pages

t open translation selector
ctrl+ s submit form

On discussion pages

n create new discussion
w toggle watching status
p toggle public/private
c toggle close/open
a open activity
r reply to discussion
l go to last reply
ctrl+ enter submit your message
(right arrow) next page
(left arrow) previous page

Settings

Want to rate or add this item to a list?

Login