DP9- An OAI Service Provider for Web Crawlers

joint work with the Los Alamos National Laboratory

DP9 is an open source gateway service that allows general search engines, (e.g.Google, Inktomi, etc.) to index OAI-compliant archives. DP9 does this by providing a persistent URL for repository records, and converting this to an OAI query against the appropriate repository when the URL is requested. This allows search engines that do not support the OAI protocol to index the “deep web” contained within OAI compliant repositories. We envision that similar gateway services for other protocols will make a wide range of resources interopable with the web. DP9 also support OAI identifier resolver and service linking.