Creating a Pentaho BI server cluster

By -
Note - This is applicable to Pentaho BI server community edition 5.x only.

Pentaho BI server provides a large set of features which are essential for  BI applications. To use this in production we might need to create a CDA cluster to maintain high availability as well as load balancing.
To create a cluster we need to configure BI server instances to use a common data source to store configurations. I configured the following setup for this.



 Follow these steps to create the cluster.

  1. Install MySQL servers and setup master master replication.
  2. Make sure you have installed Oracle Java 7 in all nodes. Using other java versions will cause runtime errors.
  3. Follow this document to to install a CDA instance. Make sure to follow the document named "Install with Your Own BA Repository" and follow the configurations related to MySQL. 
  4. Start the server and install all the components needed.
  5. Modify the cluster documentation as mentioned in this document. https://help.pentaho.com/Documentation/5.2/0P0/000/060
    1. This document is missing the information related Quartz clustering with MySQL. Only PostgresQL configuration is there. Use the following configuration instead.
      1. #_replace_jobstore_properties
        org.quartz.jobStore.misfireThreshold = 60000
        org.quartz.jobStore.driverDelegateClass = org.quartz.impl.jdbcjobstore.StdJDBCDelegate
        org.quartz.jobStore.useProperties = false
        org.quartz.jobStore.dataSource = myDS
        org.quartz.jobStore.tablePrefix = QRTZ5_
        org.quartz.jobStore.isClustered = true
        org.quartz.jobStore.clusterCheckinInterval = 20000
    2. When configuring Jackrabbit clustering replace unique ID  in<Cluster id="Unique_ID"> with a ID like CDA1.
  6. Recompress the CDA folder and copy it to all other nodes.
  7. Extract the file and replace unique ID  in<Cluster id="Unique_ID"> accordingly. eg- CDA2, CDA3
  8. Start each node and make sure there are no error logs in tomcat/logs/pentaho.log.
  9. Make sure all CDA changes are replicated between cluster nodes.
  10. When configure the ELB make sure to enable sticky sessions. http://docs.aws.amazon.com/ElasticLoadBalancing/latest/DeveloperGuide/US_StickySessions.html.
  11. Alerts should be set to monitor CDA instances as well as MySQL replication.

Comments

  1. UnknownNovember 4, 2015 at 7:14 AM

    hai Prabhath.
    Can Pentaho CE configure for HA?

    ReplyDelete
    Replies
    1. PrabhathNovember 4, 2015 at 9:33 AM

      Yes. I have tried and it works.

      Delete
    2. JardaDecember 11, 2015 at 7:32 PM

      Hi Prabhath,
      Which ELB did you use for Pentaho CE?

      Delete
  2. UnknownJanuary 6, 2017 at 1:20 PM

    Good Job Prabhath, You wrote some valuable information on Pentaho BI Server for community edition.

    Get some more details on Pentaho at Pentaho Consulting

    ReplyDelete

Post a Comment

Popular posts from this blog

Fixing Error "Failed to load VMMR0.r0 (VERR_SUPLIB_WORLD_WRITABLE)" in Virtualbox

By -
Recently I  to installed Oracle Virtualbox on my Ubuntu 12.04 computer to run Hortanworks sandbox. When I am trying to start the Sanbox it gave me an error like this. Failed to load VMMR0.r0 (VERR_SUPLIB_WORLD_WRITABLE). Unknown error creating VM (VERR_SUPLIB_WORLD_WRITABLE). What it says is /usr/bin forlder is world writable. Usually this is not world writable. But somehow I have unintentionally changed the permissions. I fixed this using the following command. chmod o-w /usr/bin
Read more

Create new Java Class files at runtime

By -
When we write programs usual method is to write all the code compile it and run. But when we try to complex things some times we may want to generate a new class and use it at runtime. As an example I wanted to create a class which parse a xml message and create a new Java object from that data. This is used in web server. So that result object varies according to the web service which is deployed. The solution was to inspect the service at deployment time and create a new parser class according to that in the service deployment time. It has to be noted that this parser had to be generated as a .class file and dynamically added to the classpath. So the result was to use a bytecode manupulation library. There are few bytecode manuplulation libraries available as ASM and JavaAssist . I used JavaAssist for this. The reason for using JavaAssist is it is simple to create a new class from the scratch using JavaAssit. When we create new class files using JavaAssit we have to create all t...
Read more

Using iReport plugin for Jasper Reports in Netbeans

By -
Image
Jasper reports is a very useful frame work for genarating reports, saving them as PDF,etc. iReport make it more easy because we can design reports using graphical methods from it. Also it is available as a plugin for NetBeans. You can download iReport Netbeans plugin from here . there are for files in the Zip folder. You can install them by at one by selecting all of them when you select the plugin to install from Netbeans (If you don't know how to install a plugin for Netbeans search for a tutorial). To use Jasper Reports in your application you have to add some libraries. But the problem is these libraries are heavily coupled with each other. So downloading each one is a very difficult task because there are problems like versions don't match, some libraries are outdated, etc.etc. There is a easy method. After installing the plugin Netbeans will automatically add the Jasper Reports library to its library collection. But it is missing one important...
Read more