Assistance de TMDB
Assistance → Assistance de l'API
Yadis and TMDb. Not able to scrape movies.
posté par peterschmidtSTAFFMOD le 5 mai 2015 à 02h46
Using Yadis as a scraper for my movies. Since a couple of days scraping a movie freezes Yadis. Series in no problem.
As a co-developer of Yadis noticed the problem is in the xml-file Yadis uses for Dutch language [nl]
Here i quote what de dev wrote on the MPC-forum:
[quote]
regarding the scraping problem, I guess your are all from netherlands...
I just made some tests and all other languages are Ok except NL. For an unknown reason it seems that TMDB wants your language to be asked in capital letters when making a search query (NL), while yadis is using small letters (nl). Small letters are working perfectly with everything but NL...
Here is how you can solve the problem :
- go to /yadis/languages folder
- open nl.xml
- first line you see should be Code: nl4. just change nl to NL
- save the file and restart yadis. It should be OK
My guess is that this is certainly a bug in TMDb that might be corrected at some point. So if in a near future you see that it's broken again, try to go back to "nl" in the same way...
[/quote]
Above is a good solution but the problem is then that what happened with moviews is now affective on tv-serie. If one changes the language to English or another Language ther is no problem in scraping both movies and series.
The dev of Yadis wrote the following about that:
[quote]
well, as there's only one ISO language naming for both TMDB and TVDB, and that the correct one should be "nl", i assume that when you change it to "NL" TMDB works, but TVDB doesn't work anymore this is definitively a bug in TMDB as this is the only language with this problem.
i would suggest to use english and wait till it's resolved. i'm going to ask Fred to have a look at it.
[/quote]
Hope that you are able to fix this. All Dutch users using Yadis are effected by this
Tia
Réponse de Travis Bell
le 5 mai 2015 à 11h58
Hi peterschmidt,
I'm a little bit confused by what you're asking. We don't switch based on 'NL' vs. 'nl'. Those are the same on our system. You can see these are the same response:
Is that what you think is the problem?
Réponse de peterschmidt
le 5 mai 2015 à 12h18
Well i am not a API specialist. But the original string was this:
string id="0">nl</string
That is in the xml from Yadis With this string Yadis didnt scrape medi-info, background etc, but 'Froze'
After the tip on MPC-club we changed 'nl' to 'NL' and then Yadis was working fine
So yes we think the problem is in the NL-nl
Réponse de Travis Bell
le 5 mai 2015 à 12h20
Hi Peter,
All I can say is that as you can see from my queries above, everything is working as it should on our end. You'll have to figure out the difference in Yadis and fix it there. I don't see any issues with the API. 'NL-nl' is not a valid language code on TMDb, so that will certainly never work.
Réponse de peterschmidt
le 5 mai 2015 à 12h26
Travis,
Thanks for looking into it. I will direct the dev from Yadis to youre answer and hope that they are able to find out whats wrong.
Greetz
Réponse de peterschmidt
le 6 mai 2015 à 08h19
Developer of Yadis provided us with a fix for this issue.
Thanks agian for looking into it as well
Case couldt be closed....