38 posts
  • Australia
  • Envato Developer
  • Envato Staff
  • Exclusive Author
  • Has been a member for 3-4 years
stevehodgkiss Dev says

Previously the API docs said that this method returns 10 of an authors newest items on a particular site. There was actually no limit to the number of items returned, so it would show all an authors items for the given site and result in some extremely slow SQL queries in certain cases.

We’ve decided to add in the limit but increase it to 25 items. I think this will be better for most uses of this API method, especially when the given author has thousands of items and you end up with a huge JSON document to parse.

API docs

Steve

973 posts
  • United Kingdom
  • Attended a Community Meetup
  • Repeatedly Helped protect Envato Marketplaces against copyright violations
  • Sold between 5 000 and 10 000 dollars
  • Has been a member for 3-4 years
  • Envato Studio (Microlancer) Beta Tester
  • Bought between 100 and 499 items
  • Referred between 10 and 49 users
  • Exclusive Author
aaranmcguire says

Noooooo!!!! That was the only good API item in the whole thing. There goes 3 mega projects of mine.

38 posts
  • Australia
  • Envato Developer
  • Envato Staff
  • Exclusive Author
  • Has been a member for 3-4 years
stevehodgkiss Dev says

Noooooo!!!! That was the only good API item in the whole thing. There goes 3 mega projects of mine.

I’m sorry to hear that! The slow SQL query behind it was causing site-wide performance issues so we had to fix it by imposing a limit.

973 posts
  • United Kingdom
  • Attended a Community Meetup
  • Repeatedly Helped protect Envato Marketplaces against copyright violations
  • Sold between 5 000 and 10 000 dollars
  • Has been a member for 3-4 years
  • Envato Studio (Microlancer) Beta Tester
  • Bought between 100 and 499 items
  • Referred between 10 and 49 users
  • Exclusive Author
aaranmcguire says


Noooooo!!!! That was the only good API item in the whole thing. There goes 3 mega projects of mine.
I’m sorry to hear that! The slow SQL query behind it was causing site-wide performance issues so we had to fix it by imposing a limit.

Is there any good way to get all a users items? maybe with an offset on the api so

http://marketplace.envato.com/api/v3/new-files-from-user:aaran.mcguire.json then http://marketplace.envato.com/api/v3/new-files-from-user:aaran.mcguire.json?offset=25

so that i can get the next 25, because I need to get a list of files from a user somehow.

2965 posts
  • Football Contest Participant/Runner-up
  • Australia
  • Community Moderator
  • Elite Author
  • Author had a Free File of the Month
  • Most Wanted Bounty Winner
  • Author had a File in an Envato Bundle
  • Has been a member for 5-6 years
  • Contributed a Blog Post
+11 more
dtbaker Volunteer moderator says

Is implementing our own html item scraper on the paginated profile pages frowned upon?

973 posts
  • United Kingdom
  • Attended a Community Meetup
  • Repeatedly Helped protect Envato Marketplaces against copyright violations
  • Sold between 5 000 and 10 000 dollars
  • Has been a member for 3-4 years
  • Envato Studio (Microlancer) Beta Tester
  • Bought between 100 and 499 items
  • Referred between 10 and 49 users
  • Exclusive Author
aaranmcguire says

Is implementing our own html item scraper on the paginated profile pages frowned upon?

Alot of work for our end, but you have to think of it like this. We want to get all items, so how can we make it easier for our servers, we can give them JSON or we can have them load profile pages several times.

3716 posts Community Moderator
  • Author had a File in an Envato Bundle
  • Grew a moustache for the Envato Movember competition
  • Community Moderator
  • Referred more than 2000 users
  • Has been a member for 5-6 years
  • United Kingdom
  • Repeatedly Helped protect Envato Marketplaces against copyright violations
  • Contributed a Blog Post
+4 more
quickandeasy Volunteer moderator says
973 posts
  • United Kingdom
  • Attended a Community Meetup
  • Repeatedly Helped protect Envato Marketplaces against copyright violations
  • Sold between 5 000 and 10 000 dollars
  • Has been a member for 3-4 years
  • Envato Studio (Microlancer) Beta Tester
  • Bought between 100 and 499 items
  • Referred between 10 and 49 users
  • Exclusive Author
aaranmcguire says
2965 posts
  • Football Contest Participant/Runner-up
  • Australia
  • Community Moderator
  • Elite Author
  • Author had a Free File of the Month
  • Most Wanted Bounty Winner
  • Author had a File in an Envato Bundle
  • Has been a member for 5-6 years
  • Contributed a Blog Post
+11 more
dtbaker Volunteer moderator says

lol @ analytics breakage.

Here’s a quick scraper that pulls out all users items.

@staff let me know if this is a no-no, even with local caching, and I can nuke this repo

https://github.com/dtbaker/envato-scraper
973 posts
  • United Kingdom
  • Attended a Community Meetup
  • Repeatedly Helped protect Envato Marketplaces against copyright violations
  • Sold between 5 000 and 10 000 dollars
  • Has been a member for 3-4 years
  • Envato Studio (Microlancer) Beta Tester
  • Bought between 100 and 499 items
  • Referred between 10 and 49 users
  • Exclusive Author
aaranmcguire says

lol @ analytics breakage.

Here’s a quick scraper that pulls out all users items.

@staff let me know if this is a no-no, even with local caching, and I can nuke this repo

https://github.com/dtbaker/envato-scraper

Nice code, I downloaded it just in case its a No No, they killed a few projects of mine so im going to use the scraper even if they say no..

by
by
by
by
by
by