Crawling Public Documents - Directory Feed
Timothy: Hi again. I hope you have understood all the concepts that are required to create an XML connector source. This is also called RSS. Going forward, lets use the term RSS. I have generated all the required configuration files, and I have stored them in a directory. I have sample data feeds that are stored in a directory.
Steve: So, would you be showing us how a configuration file looks like to crawl a directory feed before we create an RSS Source?
Timothy: Yes. We will first see how the configuration file should be generated; how it should specify the feed location, feed type, and so on. To keep it simple, first we will do a public crawl. I will show you how to register a new Source Type, called RSS, and then we will create an RSS source and crawl the data feeds.
Steve: That sounds great. I can't wait to see the steps. I am all excited!!
Click the Show Me link to watch Timothy in action.
 |
