Challenge

In order to get full advantage of the current business system and to get quick and easy access of all the relevant information, client has decided to develop and launch "Web Content Crawler".

"Web Content Crawler" has a wide range of goals and objectives out of which the prime considerations are listed below:

  • Devising as information retrieval system that can extract the useful information as much as possible and with minimum amount of time.
  • Minimizing the overhead of a user for locating the needed and useful information.
  • Quick and easy access to high quality documents to provide required and relevant information to user within acceptable time.
  • Information to be displayed in order of their relevance with respect to user query.
  • Facilitates updates of information repository as frequently as possible with the web content's actual change of frequency.
Solution

TatvaSoft provided a solution developed in SharePoint that was extremely useful and was intended to provide quick and instant access to information with features listed below:

  • Managing Search and Feeds :
    • Pure RSS Feed: It allows user to configure pure RSS feed that includes title, feed URL, category for the RSS feed, making feed enable for publishing.
    • Pure Facebook and Twitter: It facilitates user to manage items for pure Facebook and twitter that includes title, category, username, crawl type and publishing the feed.
  • Country Exchange Rate: It manages exchange rates of different countries.
    • Base Currency: It allows user to configure default value for base currency. This value is saved on online interface developed in SharePoint when user will save crawled currency values.
    • Manage Currency Codes: This allows user to configure new country for Exchange Rate by providing country name and currency code.
    • Manage Exchange Rate: This feature will provide list of Exchange Rates set for different countries. Also, user can set and manage Exchange Rates of countries.
  • Web Crawling: Crawling the specified URL and retrieves the current results from the web pages.
  • Execute Pure RSS Search: it will fetch and display search results from RSS search. User can select feed to retrieve the needed information by searching that RSS feed. User can also reload the feed if required.
  • Execute Pure Facebook and Twitter Search: Facilitated crawling of data from Facebook and Twitter using specific URLS.
  • Configuration of application: It allows creating new Facebook app. User can also manages details of the application by updating the application specific information.
  • Custom Views of Content Pool: It provides option to view items as all, published and unpublished items.
  • View Favorite posts: It will show list of all the favorite posts of user logged into system.
Result

The client has derived many business benefits by its association with TatvaSoft. This includes configuration of search to target precisely what is needed by ignoring certain types of references or sites. Continuous monitoring of web for search areas specified and returning results as they are uncovered, providing access to information in localities with limited or restricted web access, reducing network traffic and monitoring the change of the relevant areas of web space.

Technology
  • Web Server: Microsoft Office SharePoint Server
  • Technology: Microsoft Office, C#
  • Database: Microsoft SQL Server