Implement SOLR “document level security” using Manifold Connector Framework (ManifoldCF)

SOLR Security with ManifoldCF

Introduction:

This article explains how to implement SOLR “document level security” using Manifold Connector Framework (ManifoldCF). ManifoldCF is an open source framework for pulling content out of a repository and sending it on to targets such as SOLR via a plug-in style and connector-based architecture. ManifoldCF includes connectors for numerous commercial and open source data sources, including Documentum, SharePoint, JDBC and RSS. ManifoldCF also defines a security model for target repositories that permits them to enforce source-repository security policies.

The ManifoldCF security model is based loosely on the standard authorization concepts and hierarchies found in Microsoft’s Active Directory. ManifoldCF defines the concept of an access token. As per the ManifoldCF security model, it is the job of the authority to provide a list of access tokens for a given searching user. Multiple authorities cooperate, in that each one can add to the list of access tokens describing a given user’s security.

The sections below are about setting up ManifoldCF, ManifoldCF crawler usage and configuring ManifoldCF plugin with SOLR.

  • Setup ManifoldCF
  • Configuration of ManifoldCF with SOLR

Setup ManifoldCF:

This section explains how to setup ManifoldCF.

Download ManifoldCF binary distribution from -
https://manifoldcf.apache.org/en_US/download.html and unzip it

Open command prompt and use start.bat to start ManifoldCF as shown below:

2

This will start ManifoldCF, get the required services running and the desired connection types properly registered.

Overview:

  • ManifoldCF user interface can be accessed using crawler.

http://localhost:8345/mcf-crawler-ui/login.jsp

When you enter the Framework user interface for the first time, you will first be asked to log in

3

  • Enter the login username and password for your system. By default, the user name is "admin" and the password is "admin". The screen should look something like this:


Untitled

Output Connections:

  • Create an output connection by selecting the "List Output Connections" option
  • Enter the Name, the Description and click on the “Type” tab to select SOLR output connection and then click on "continue"

5

  • Select the "Single server" option from Solr type, since we are setting up in a single box

6

  • Select the "Server" tab to configure SOLR
7
  • Select the "Schema tab" to enter primary key information about the existing Solr collection and save

78

  • Authority Groups: Create an authority group by clicking on the "List Authority Groups" and "Add a new authority group" options

8

User Mapping Connections:

  • Create a mapping connection by clicking on the "List User Mapping Connections" and "Add a new connection" options

9

  • Select the "Type" tab as the regular expression mapper and save. If everything is good, the crawler displays - "Connection working"


10

Authority Connections:

  • Create an authority connection by clicking on the List Authority Connections link
  • Create a new connection by clicking on Add new connection
  • Enter name and description and click on "Type" to select "Authority type" as follows:


11

  • Select the authority group which was created before and save it.


12

Configuration of ManifoldCF plugin with SOLR:

This section provides a step by step process to configure ManifoldCF plugin with Solr.

  • Copy from $:\apache-manifoldcf-2.3\plugins\solr\solr-X.X\apache-manifoldcf-solr-X.X-plugin-2.2.JAR to Solr core lib directory

There are two ways to hook up security to Solr in this package. The first is using a Query Parser plugin. The second is using a Search Component. In both cases, the first step is to have ManifoldCF installed and running.


2

0 Comments

Request a Live Demonstration

Take the first 2 steps towards relevant deep insights with our 3RDi Enterprise Platform
  1. Register and get the test login details for 3RDi Enterprise Suite
  2. Take a tour, start experiencing

Existing users can click here


Reach out to us for any questions or queries

By submitting this form, you are consenting to receive emails from The Digital Group team, you can unsubscribe at any time.