Search Integration For Tridion

WP
by Will Price55 views·Updated Jun 7, 2013
Powered by AI

Need to present on this topic?

Create your own polished presentation in minutes. Just describe what you need.

Free to try, no credit card required

Transcript

Our Goal

Indexing Strategies

Intention is to support the following indexing strategies:

  • Simple
  • Focused on getting data into the index
  • Effective - 90% of requirements
  • Easy to extend
  • PUSH (directly push data into the index)
  • NOTIFY (notify engine to index content from published site)
  • FILE (place XML files & Binaries on server and notify search engine to index them)

3. Configure

Deployer

Inject!

Architecture

  • Add si4t.jar & si4t-solr.jar (or other)
  • Configure cd_storage_conf.xml

1. Setup Search

  • Framework is loosely injected into the Tridion Storage Layer
  • Makes full use of the DAO Bundle Pattern
  • Extends Tridion Factory Classes to be transactional
  • Libs are configured on the Tridion Deployer
  • Solr compatible 'out of the box'
  • Configure standard index fields

<StorageBindings>

<Bundle src="SearchDAOBundle.xml"/>

</StorageBindings>

<Storage Type="persistence" Id="defaultdb" dialect="MSSQL" Class="com.tridion.storage.si4t.JPASearchDAOFactory">

<Pool Type="jdbc" Size="5" MonitorInterval="60" IdleTimeout="120" CheckoutTimeout="120" />

<DataSource Class="com.microsoft.sqlserver.jdbc.SQLServerDataSource">

<Property Name="serverName" Value="MyDBServer" />

<Property Name="portNumber" Value="1433" />

<Property Name="databaseName" Value="mybrokerdb" />

<Property Name="user" Value="mybrokerdbusername" />

<Property Name="password" Value="mybrokerdbpassword" />

</DataSource>

<Indexer Class="org.si4t.solr.SolrIndexer" Mode="http" DefaultCoreUrl="http://localhost:8080/solr/staging" DocExtensions="pdf,docx,doc,xls,xlsx,pptx,ppt">

<Urls>

<!-- override specific Publications -->

<Url Value="http://localhost:8080/solr/staging" Id="12" />

</Urls>

</Indexer>

</Storage>

2. Add TBBs

4. Publish

Add to Page Template:

  • Generate Index Data
  • Add Index Data to Output

Search Engine Integration: Stop Reinventing the Wheel!

Setup

Get the basics working

Field Processing Behaviour

  • Inclusive or Exclusive
  • Map fields
  • Embed linked content

Scaling...

1

Will Price & Raimond Kempees

Config granularity

  • Defaults
  • PT override
  • CT override

Framework Supports:

Configure

Other options...

  • Suppress individual pages
  • Minimum CT Prio

Control what is indexed

  • Multiple storage configuration elements
  • Mixed configurations for DB and FS publishing
  • Different Indexer implementations per storage node
  • The ability to configure explicit publications to index per storage node

2

Binary Content

  • Textual Content can be indexed
  • Configurable
  • Solr: Apache Tika

Open Source

Extending is Easy

Can you code a TBB to generate some XML?

https://github.com/SI4T

http://si4t.github.io/SI4T/

Default TBBs and XML serialization extensible, so most of the hard work done for you

3

Extend

  • SI4T/SI4T - Framework
  • SI4T/Solr - Solr specific

What about the deployer?

Try the framework yourself:

  • Setup in < 2 hours
  • Tridion 2011 +
  • Modular Templating

No need to touch it if you use Solr

Do your own thing!

...For other search engines you will need to write a little bit of java to handle the insertion/removal from the index. Use the Solr code as an example and then share for the rest of the world

Contribute:

  • Other Search Engines
  • GUI for configuration (App Data?)
  • Crawler notification storage extension
  • Nodeploy storage extension
  • FS/XML storage extension
  • .NET/Java/Javascript query examples
  • Review our shonky code

4