<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>Copac Developments &#187; harvesting</title>
	<atom:link href="http://copac.ac.uk/development-blog/tag/harvesting/feed/" rel="self" type="application/rss+xml" />
	<link>http://copac.ac.uk/development-blog</link>
	<description>What's happening behind the scenes at Copac</description>
	<lastBuildDate>Wed, 23 Nov 2011 15:28:59 +0000</lastBuildDate>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.3</generator>
		<item>
		<title>Copac Beta can search your library too</title>
		<link>http://copac.ac.uk/development-blog/2009/07/copac-beta-can-search-your-library-too/</link>
		<comments>http://copac.ac.uk/development-blog/2009/07/copac-beta-can-search-your-library-too/#comments</comments>
		<pubDate>Thu, 09 Jul 2009 11:08:32 +0000</pubDate>
		<dc:creator>Ashley</dc:creator>
				<category><![CDATA[D2D]]></category>
		<category><![CDATA[Interfaces]]></category>
		<category><![CDATA[harvesting]]></category>
		<category><![CDATA[searching]]></category>
		<category><![CDATA[Z39.50]]></category>

		<guid isPermaLink="false">http://copac.ac.uk/development-blog/?p=272</guid>
		<description><![CDATA[One of the new features we are trailing in the new Copac Beta is the searching of your local institutions library catalogue alongside Copac. To do this we need to know which Institution you are from and whether or not your Institutional library catalogue can be searched with the Z39.50 protocol. To identify where you [...]]]></description>
			<content:encoded><![CDATA[<p>One of the new features we are trailing in the new <a href="http://beta.copac.ac.uk">Copac Beta</a> is the searching of your local institutions library catalogue alongside Copac. To do this we need to know which Institution you are from and whether or not your Institutional library catalogue can be searched with the Z39.50 protocol.</p>
<p>To identify where you are from, we are using information given to us during the login process. When you login, your Institution gives us various pieces of information about you, including something called a scoped affiliation. For someone logging in from, say, the University of Manchester, the scoped affiliation might be something like &#8220;student@manchester.ac.uk&#8221;</p>
<p>Once we know where you are from, we search a database of Institutional Z39.50 servers to see if your Institution&#8217;s library is searchable. If it is we can present the extra options on the search forms, and indeed, fire off any queries to your library catalogue.</p>
<p>Our database of Z39.50 servers is created from records harvested from the <a href="http://iesr.ac.uk/">IESR</a>. So, if you&#8217;d like your Institution&#8217;s catalogue available through Copac, <a href="http://iesr.ac.uk/contribute/">make sure it is included in the IESR by talking to the nice people there</a>.</p>
<p>Many thanks to everyone who tried the Beta interface early on and discovered that this feature mostly wasn&#8217;t working. You enabled us to identify some bugs and get the service working.</p>
]]></content:encoded>
			<wfw:commentRss>http://copac.ac.uk/development-blog/2009/07/copac-beta-can-search-your-library-too/feed/</wfw:commentRss>
		<slash:comments>1</slash:comments>
		</item>
		<item>
		<title>Harvesting records from Copac with OAI-PMH</title>
		<link>http://copac.ac.uk/development-blog/2008/08/harvesting-records-from-copac-with-oai-pmh/</link>
		<comments>http://copac.ac.uk/development-blog/2008/08/harvesting-records-from-copac-with-oai-pmh/#comments</comments>
		<pubDate>Wed, 13 Aug 2008 12:08:07 +0000</pubDate>
		<dc:creator>Ashley</dc:creator>
				<category><![CDATA[Interfaces]]></category>
		<category><![CDATA[Machine-to-machine]]></category>
		<category><![CDATA[harvesting]]></category>
		<category><![CDATA[oai-pmh]]></category>

		<guid isPermaLink="false">http://copac.ac.uk/development-blog/?p=21</guid>
		<description><![CDATA[We have recently implemented an OAI-PMH interface to Copac (access details can be found on our Copac Interfaces web page.) It has passed all the tests of the OAI-PMH protocol validator hosted by the Open Archives Initiative, so I&#8217;m reasonably confident we have a useable service up and running. The niggling doubt I have is [...]]]></description>
			<content:encoded><![CDATA[<p>We have recently implemented an <a title="The Open Archives Initiative Protocol for Metadata Harvesting" href="http://www.openarchives.org/OAI/openarchivesprotocol.html">OAI-PMH</a> interface to Copac (access details can be found on our <a href="http://copac.ac.uk/interfaces/oai-pmh/">Copac Interfaces</a> web page.) It has passed all the tests of the <a href="http://www.openarchives.org/data/registerasprovider.html">OAI-PMH protocol validator</a> hosted by the<a href="http://www.openarchives.org/"> Open Archives Initiative</a>, so I&#8217;m reasonably confident we have a useable service up and running. The niggling doubt I have is that theÂ <a href="http://www.purl.org/NET/oai_explorer">OAI Repository Explorer</a>Â seems to have a problem parsing the <a href="http://www.loc.gov/standards/mods/">MODS</a> records we deliver â€” it has no problems with our <abbr title="Dublin Core">DC</abbr> records, so I&#8217;m hoping it is a problem at their end, not ours. If you know different then please let us know!</p>
<p>Several Sets are available through which you can harvest sub-sets of the Copac database. We currently have only four Sets: Music, Sounds, Images and Maps. If there are sub-sets of the Copac database you think it would be useful to harvest and are not in the list, then let us know and we&#8217;ll see what we can do. (We are limited in what Sets we offer by what is easily and efficiently searched for in the database.)</p>
<p>The Copac database contains almost 34 million records. We are a little worried about theÂ performanceÂ hit our servers (and hence our users) might suffer should someone decide to try and harvest the whole of the database. Therefore, we areÂ currentlyÂ insisting that any ListRecords or ListIdentifiers requests must specify a Set. If no Set is specified then a BadArgument error is returned.</p>
<p>Unfortunately we do not maintain information about deleted records, so it will be necessary to periodically re-harvest records from us. I wish we could offer deletion information, however the way we receive records from our contributing Institutions and the de-duplication process makes it very difficult to track deletions and keep a stable record number. But suchÂ difficultiesÂ are probably a blog post for the future.</p>
]]></content:encoded>
			<wfw:commentRss>http://copac.ac.uk/development-blog/2008/08/harvesting-records-from-copac-with-oai-pmh/feed/</wfw:commentRss>
		<slash:comments>1</slash:comments>
		</item>
	</channel>
</rss>

