mod_deflate compressing your Connections pages before they hit the client

I have also posted this over on the Cube Soft Blog
The Apache v2 module mod_deflate is extremely handy if you are serving IBM Connections up to remote locations with little bandwidth. Some of the Connections pages have large css or java script files that are required to function correctly but for countries that have poor connection to the remote server this causes slow page load times and sometimes timeouts.

So mod_deflate to the rescue ..

open your httpd.conf file and ensure that the mod_deflate is uncommented

LoadModule deflate_module modules/mod_deflate.so

just before section 3 for virtual hosts – add the following

## set deflate

SetOutputFilter DEFLATE
# Netscape 4.x has some problems…
BrowserMatch ^Mozilla/4 gzip-only-text/html
# Netscape 4.06-4.08 have some more problems
BrowserMatch ^Mozilla/4\.0[678] no-gzip
# MSIE masquerades as Netscape, but it is fine
# BrowserMatch \bMSIE !no-gzip !gzip-only-text/html
# NOTE: Due to a bug in mod_setenvif up to Apache 2.0.48
# the above regex won’t work. You can use the following
# workaround to get the desired effect:
BrowserMatch \bMSI[E] !no-gzip !gzip-only-text/html
# Don’t compress already-compressed files
SetEnvIfNoCase Request_URI .(?:gif|jpe?g|png)$ no-gzip dont-vary
SetEnvIfNoCase Request_URI .(?:exe|t?gz|zip|bz2|sit|rar)$ no-gzip dont-vary
SetEnvIfNoCase Request_URI .(?:avi|mov|mp3|mp4|rm|flv|swf|mp?g)$ no-gzip dont-vary
SetEnvIfNoCase Request_URI .pdf$ no-gzip dont-vary
DeflateCompressionLevel 9

### Section 3: Virtual Hosts

Note – I have the DeflateCompressionLevel set to 9 – this is the highest amount of compression. Depending on the load and size of your HTTP server this may use a lots of CPU time to deflate, this may need to be monitored and tuned for your specific server

Inside the virtual host for the secure Connections server add the same deflate directive (see example below)


ServerName yourservername.com
SSLEnable
Include “/opt/IBM/HTTPServer/conf/rewrite.conf”
Header set Access-Control-Allow-Origin “*”
## set deflate

SetOutputFilter DEFLATE
# Netscape 4.x has some problems…
BrowserMatch ^Mozilla/4 gzip-only-text/html
# Netscape 4.06-4.08 have some more problems
BrowserMatch ^Mozilla/4\.0[678] no-gzip
# MSIE masquerades as Netscape, but it is fine
# BrowserMatch \bMSIE !no-gzip !gzip-only-text/html
# NOTE: Due to a bug in mod_setenvif up to Apache 2.0.48
# the above regex won’t work. You can use the following
# workaround to get the desired effect:
BrowserMatch \bMSI[E] !no-gzip !gzip-only-text/html
# Don’t compress already-compressed files
SetEnvIfNoCase Request_URI .(?:gif|jpe?g|png)$ no-gzip dont-vary
SetEnvIfNoCase Request_URI .(?:exe|t?gz|zip|bz2|sit|rar)$ no-gzip dont-vary
SetEnvIfNoCase Request_URI .(?:avi|mov|mp3|mp4|rm|flv|swf|mp?g)$ no-gzip dont-vary
SetEnvIfNoCase Request_URI .pdf$ no-gzip dont-vary
DeflateCompressionLevel 9

restart the HTTP server and the deflate module will be active

You can test the compression by visiting http://www.whatsmyip.org/http_compression/ and enter a url of a Connections page

For instance I put the profiles page of a customer’s server here that mod_deflate is enabled and the compression was a massive 67.4%

Original Size: 7.27 KB
Compressed Size: 2.37 KB
Data Savings: 67.4%

So all in all if you have sites that are in bandwidth starved places – mod_deflate is worth taking a look at.

ConnCtrl bash script for IBM Connections

I have also blogged this over on the Cube Soft company blog – with my good friend <a href=”http://twitter.com/TimsterC” title=”TimsterC” target=”_blank”>Mr Tim Clark</a> we have created a script for starting and stopping IBM Connections on Red Hat (RHEL)

 

The script has a bunch of variables to allow you to input the path to the WebSphere deployment manager and nodes, and a place to enter the names of your Connections servers.

Please visit Tim’s blog for all the information and to download the script.

Connections 4.0 cr issues when you have a shared data folder not on the WAS server

We have spotted a lovely issue with patching Connections 4 to CR2 and above when using a < connections path > /data/shared folder on anything other than a single WAS node.

For example in a standard one node connections install the < connections path > /data/shared folder is on the same machine as the connections instance .. in a multi-node instance the shared data folder is normally on a san / network share.

In my instance the shared data was on a RHEL nfs share that was mapped to the node machines as a filesystem, we had seen no issue with this at all, until we attempted to update the Connections version 4.0 instance to CR4 – the CR4 updates installed correctly but on starting the connections servers up, the news feed and a lot of the widget data was not displaying correctly – throwing a javascript error!! I was stumped, I had seen this before, this particular instance is owned and run by a non root user, when the instances are started as root the permissions are not set correctly and it throws an error.

This was not the case here. The non root user owned all the files and had started the Connections servers, so it should work. There appeared to be no obvious errors in the SystemOut logs for the servers.

Flummoxed by this – I rolled the patches off, at Connections 4.0 again restarted the servers and it worked correctly.

Convinced there may be an issue in CR4 I decided to attempt CR2, so later on in the week had another attempt at patching. Stuart was also doing some maintenance on another customer machine at the same time so we worked through it together. Once the CR2 patches were installed correctly we saw the same issue. So with Stuart checking the errors thrown and I checking the logs and a fiddler trace we managed to deduce that when the fix packs were applying , the wrong webresources directory was being updated.

Under < connections path > /data/shared/provision/webresources on the local machine – all the files had been updated with the new fix pack files NOT the actual shared data folder on the network share. The WebSphere variable for the instance has the correct folder mapped and all the other files from the /data/shared folder are being served correctly.

The quick resolution to this was to delete all the files under the networked share folder /provision/webresources and copy the files from the local machine /data/shared/provision/webresources – restart the servers and as if by magic it works.

IBM have acknowledged that this is an issue and hopefully we wont see this issue again .. but IF you see something similar and you have a shared folder that is not on your connections machine – check to ensure the correct set of files has been updated.

Yet another one of those *fun* fixes – hope it helps someone else save some pain

Connections 4.x search – well that was a weird problem

If you have migrated or moved an IBM Connections instance from 3.0.1 > 4.x (either 4.0 or 4.5) or moved data between 4.x servers you may have noticed a weird issue with searching, especially around communities.

The reason I have been a bit quiet on the blog of late is because I am working on a few Connections projects many of which have involved migrating data between test and live servers or replicating data between servers. I have come across a few issues relating to search so I thought I would share them to save you guys the pain.

Everyone knows when you migrate or move data between servers you should clear the scheduled tasks and rebuild the search indexes – but in V4.x a new set of search data came in for Community searching – the catalog.

When the search task runs is collects a bunch of information about communities for the lists you see under the my communities tab and public communities – it collects this in the catalog.

The issues I was seeing was that all historical data regarding Community membership and Public communities was not being shown and that is because of the catalog.

There are a couple of places that catalog data is stored and you can check this by looking up the WebSphere variables :

CATALOG_INDEX_DIR
CATALOG_REPLICATION_DIR

Typically CATALOG_INDEX_DIR is stored in < Connections install > /data/local/catalog/index

and CATALOG_REPLICATION_DIR is stored in < Connections install > /data/shared/catalog/indexReplication

there is also a temporary folder in your os tmp directory called indexCreationDir in the case of most linux systems it is /tmp/indexCreationDir

When you run your data migration and delete the search index under < Connections install > data/local/search ( I normally rename the index folder to #index)

also rename or remove the Places folder under < Connections install >/data/local/catalog/index/ and < Connections install > /data/shared/catalog/indexReplication and remove or rename the /tmp/indexCreationDir

once you restart Connections run an index now to rebuild the indexes, seedlist and the catalog data and your search will function as expected.

for example:

execfile(“searchAdmin.py”)

SearchService.indexNow(“activities, blogs, calendar, communities, dogear, files, forums, profiles, status_updates, wikis”)

 

I am sure that our resident Community script guru (Mr Christoph Stoettner) could script clearing these but for now its a manual process – hope this will save you some head aches on upgrades and migrations 🙂

 

 

 

 

 

Issues with Install manager GUI on RHEL 6.3 ?

If you are attempting to install Connecitons 4.5 on RHEL 6.3 you will have noticed that there is an issue with using the GUI for the IBM Installation Manager with Red Hat Enterprise Linux 6.3

The IM won’t fire up a GUI even though xterm works for other GUI’s on the machine, no errors, no splash screen, no nothing !!

It has been driving both Stuart and I bonkers .. after a lot of digging here is what you need to get it to work :

yum install gtk2.i686 gtk2-engines.i686 PackageKit-gtk-module.i686 PackageKit-gtk-module.x86_64 libcanberra-gtk2.x86_64 libcanberra-gtk2.i686

I ran this and hey presto a splash screen …

So to save your pain .. install the gtk2 packages above 🙂

Happy installing

 

 

Social Connections V – coming soon

The international and independent IBM Connections user group will be visiting beautiful Zurich, Switzerland on June 28th 2013!

IBM Switzerland has graciously offered us the use of their IBM Client Center and it already promises to be a busy day

To register for this event please visit our registration page here, or use the button below:

Social Connections IV fun in Amsterdam

After months of planning, much panicking by certain members of the SOCCNX team and a small amount of winging it – the 4th Social Connections User Group for IBM Connections Users hit Amsterdam on the 30th of November 2012.

Considering this user group was an idea that Stuart and I had over a coffee in the Uni cafe a couple of years ago, we have gone from 60 attendees at Social Connections I to a massive 203 attendees from 16 countries representing 99 unique organisations at Social Connections IV.

A big thank you to all of our speakers and sponsors we couldn’t hold these events without you. We have had a huge amount of support and encouragement from the Community and the day was amazing. IBM Benelux were fantastic hosts and helped the team out no end.

I am proud to be a member of the organising committee of the only IBM Connections User group.

Our next event will hopefully be in June 2013 in the USA, we are already in the deep planning stage now. We are actively looking for sponsors and as soon as we have confirmed a date and location we will be opening up registration and abstract submission. For more information please check out

Thanks again to everyone who made it such a great day 🙂

Social Connections III – 3 weeks to go

Only a few weeks until the 3rd Social Connections user group, held in the IBM Labs Dublin.

We have a few places left if you are interested in attending this unique user group. We have some fantastic sessions such as:

and many more … the full agenda can be found on the Social Connecitons site here

 

As well as a full agenda planned for the day with two tracks – one for business and one for technical and admin – we have some other plans for the day in store.

If you can join us after the event we have an evening dinner and reception planned for at the Guinness Store House

There will be a tour of the storehouse, information on the history of Guinness and the chance to pull your own pint – followed by dinner and drinks in the fantastic surroundings of Arthur’s Bar.

Arthur's Bar 1 Arthur's Bar 2

Arthur’s Bar: A new edition to GUINNESS STOREHOUSE but as old as Ireland itself. It’s a traditional Irish pub, a place of hospitality. This communal gathering space is somewhere to relax and experience the heart of the Irish community whilst enjoying the breathtaking views of St. James’s Gate Brewery and Dublin city

 

The spaces for this event are limited and will be on a first come first served basis. Please sign up and let us know as soon as you can if you would like to attend.

Looking forward to seeing you on the 22nd of June in Dublin.

Customizing Connections Demo Files

The demo files that acompany my Customizating Connections Presentation can now be downloaded here

Inside the zip file you will find :

The templates and css files from \customization\common\nav
The custom community thumbnail image from \customization\communities\images
The custom strings required for the twitter profile extention  from \customization\strings
The JustNudge profile twitter ear file – LCC_Twitter_EAR-latest.ear
Instructions on how to deploy this and how to extend the profile – add twitter widget.txt
Examples of the following config files :
communities-config.xml
profiles-config.xml
widgets-config.xml

Enjoy 🙂