|
| 1 | +title: Updates to our Search API |
| 2 | +--- |
| 3 | +author: aioannidis |
| 4 | +--- |
| 5 | +body: |
| 6 | + |
| 7 | +As Zenodo continues to grow, we're working to keep the service fast and reliable for everyone. We've noticed that automated systems harvesting content from Zenodo have been slowing things down for researchers who are browsing, searching, and uploading their work. We're introducing new limits on our search REST API endpoints to address this issue. |
| 8 | + |
| 9 | +### What's changing? |
| 10 | + |
| 11 | +Starting today, we're enforcing the following limits on our **records search REST API endpoints**: |
| 12 | + |
| 13 | +- **Page sizes**: Maximum 25 results per page for anonymous requests, 100 results per page for authenticated requests |
| 14 | +- **Request frequency**: Maximum 30 requests per minute (for both anonymous and authenticated users) |
| 15 | + |
| 16 | +These limits ensure that Zenodo remains responsive for everyone. The higher page limit for authenticated requests also allows us to contact users if we notice usage patterns that our other APIs could better serve. |
| 17 | + |
| 18 | +### Why these changes? |
| 19 | + |
| 20 | +Our infrastructure prioritizes researchers who are searching, browsing, and discovering content on Zenodo. But we've seen automated systems request very large amounts of data very quickly, which uses up resources and slows things down for everyone else. |
| 21 | + |
| 22 | +After analysing current access patterns, we designed these new limits accommodate typical use cases. If you're just searching for related work, browsing records, or managing your community, you won't notice a difference. |
| 23 | + |
| 24 | +### Better alternatives for bulk data access |
| 25 | + |
| 26 | +If you've built scripts, applications, or integrations using the search API for bulk harvesting, or need large amounts of Zenodo metadata (to build indexes, perform analysis, or keep external systems synchronized), we highly recommend using the following methods: |
| 27 | + |
| 28 | +- **[OAI-PMH](https://developers.zenodo.org/#oai-pmh)**: A standardized protocol for harvesting metadata and keeping systems synchronized with repositories like Zenodo. It supports incremental updates (only fetching what's new or changed), filtering by community, and multiple metadata formats. OAI-PMH delivers 50 records per page and has the same 30 requests per minute limit. |
| 29 | +- **[Metadata dumps](https://developers.zenodo.org/#metadata-dumps)**: Monthly exports of all Zenodo metadata that you can download and process on your own systems. This is the most efficient way to access bulk metadata, especially if you need to analyze large portions of Zenodo's content. The dumps are available in DataCite XML and JSON formats. |
| 30 | + |
| 31 | +### Looking ahead |
| 32 | + |
| 33 | +We're working to scale Zenodo sustainably while keeping the service responsive and user-friendly. We'll closely monitor how these changes perform and make adjustments if needed. |
| 34 | + |
| 35 | +If you have questions regarding these changes, or need help transitioning to OAI-PMH or metadata dumps, please [contact our support team](https://zenodo.org/support). |
| 36 | + |
| 37 | +--- |
| 38 | +date: 2025-11-13 |
0 commit comments