Tuesday, 23 January 2018

IBM Integration Bus - Integration Toolkit on Red Hat Enterprise Linux

This is another of my various tinkering exercises ….

I'm attempting to get the IBM Integration Bus (IIB) 9 Toolkit working on my Mac, against a VM running Red hat Enterprise Linux 7.4.

I'm actually tunnelling X11 via SSH ( via ssh -y wasadmin@hostname )

When I attempt to start the Toolkit: -

/opt/ibm/IntegrationToolkit90/launcher 

I see this: -

MQSI 9.0.0.2
/opt/ibm/mqsi/9.0.0.2

 progressRectString:  2,489,646,12
 messageRectString: 12,443,444,15
Unhandled exception
Type=Segmentation error vmState=0x00040000
J9Generic_Signal_Number=00000004 Signal_Number=0000000b Error_Value=00000000 Signal_Code=00000080
Handler1=F6B5EACA Handler2=F6B0F017 InaccessibleAddress=00000000
EDI=F750FCA4 ESI=F750FB64 EAX=F7510BF0 EBX=ADA45000
ECX=BFD95F61 EDX=F750FA98
EIP=AD958FAE ES=002B DS=002B ESP=F750FA28
EFlags=00010286 CS=0023 SS=002B EBP=F751000C
Module=/lib/libcairo.so.2
Module_base_address=AD905000
Target=2_60_20120809_118929 (Linux 3.10.0-693.11.6.el7.x86_64)
CPU=x86 (1 logical CPUs) (0x1e7da8000 RAM)
----------- Stack Backtrace -----------
(0xF6B005B0 [libj9prt26.so+0xf5b0])
(0xF6B0FFC2 [libj9prt26.so+0x1efc2])
(0xF6B002A1 [libj9prt26.so+0xf2a1])
(0xF6B00395 [libj9prt26.so+0xf395])
(0xF6AFFEA4 [libj9prt26.so+0xeea4])
(0xF6B0FFC2 [libj9prt26.so+0x1efc2])
(0xF6AFFE13 [libj9prt26.so+0xee13])
(0xF6B5DEF5 [libj9vm26.so+0x14ef5])
(0xF6B0FFC2 [libj9prt26.so+0x1efc2])
(0xF6B5E1FE [libj9vm26.so+0x151fe])
(0xF6B5EB18 [libj9vm26.so+0x15b18])
(0xF6B0F1E5 [libj9prt26.so+0x1e1e5])
__kernel_rt_sigreturn+0x0 (0xF7784410)
(0x00023280 [<unknown>+0x0])
---------------------------------------
JVMDUMP039I Processing dump event "gpf", detail "" at 2018/01/23 15:49:57 - please wait.
JVMDUMP032I JVM requested System dump using '/opt/ibm/IntegrationToolkit90/core.20180123.154957.90680.0001.dmp' in response to an event
JVMPORT030W /proc/sys/kernel/core_pattern setting "|/usr/libexec/abrt-hook-ccpp %s %c %p %u %g %t e %P %I %h" specifies that the core dump is to be piped to an external program.  Attempting to rename either core or core.90725.

JVMDUMP010I System dump written to /opt/ibm/IntegrationToolkit90/core.20180123.154957.90680.0001.dmp
JVMDUMP032I JVM requested Java dump using '/opt/ibm/IntegrationToolkit90/javacore.20180123.154957.90680.0002.txt' in response to an event
JVMDUMP010I Java dump written to /opt/ibm/IntegrationToolkit90/javacore.20180123.154957.90680.0002.txt
JVMDUMP032I JVM requested Snap dump using '/opt/ibm/IntegrationToolkit90/Snap.20180123.154957.90680.0003.trc' in response to an event
JVMDUMP010I Snap dump written to /opt/ibm/IntegrationToolkit90/Snap.20180123.154957.90680.0003.trc
JVMDUMP013I Processed dump event "gpf", detail "".

Appreciating that this is almost certainly an unsupported configuration, I was able to solve the problem, using this as inspiration: -


which said, in part: -

Cause

"adwaita-gtk2-theme" (32 and 64 bit) and "adwaita-gtk3-theme" 64 bit libraries were missing.

Resolving the problem

Install the missing libraries "adwaita-gtk2-theme" (32 and 64 bit) and "adwaita-gtk3-theme" 64 bit. Please contact RedHat to obtain the missing libraries.

I installed the missing RPM: -

/usr/bin/yum --noplugins install -y adwaita-gtk2-theme

  adwaita-gtk2-theme.x86_64 0:3.22.2-1.el7                                                                                                                                                               

Complete!

Removed temporary configuration


and now we're good to go.

For the record, I'd previously installed these two RPMs: -

libpng12.so.0
libXtst.so.6


as required by IBM Installation Manager, installing the Toolkit.

IBM BPM 8.6 - Upgrading to CF2017.12

In December, IBM released an update to IBM Business Process Manager 8.6, specifically the Cumulative Fix 2017-12, aka CF2017.12.

This is what it included, in part: -

Update to IBM BPM V8.6 CF2017.12 to experience all the highlights, such as these added abilities and improvements:

IBM BPM
• Simplify user task authoring with inline user tasks
• Model decision logic in the web IBM Process Designer
• Experience enhanced support of coach views for use in IBM Robotic Process Automation with Automation Anywhere
• Gain more insight into IBM BPM process applications
• Benefit from enhanced process application validation support
• Efficiently manage multiple library items in Process Designer
• Revert library items in Process Designer
• Learn how to use IBM App Connect
• Restrict rights to create and update saved searches by using an action policy


Having downloaded the Cumulative Fix a month or so back, I decided to work through the installation.

The first thing to note is that the CF comes as a .ZIP file, specifically an Installation Manager "Delta" repository.

Compared to the original 8.6 Delta Repo: -

ls -alh /Volumes/DaveHaySSD/Software/BPM86/Fixpacks/

total 9360184
drwxr-xr-x  4 davidhay  staff   136B  5 Jan 15:56 .
drwxr-xr-x  5 davidhay  staff   170B 19 Jan 10:08 ..
-rw-r--r--  1 davidhay  staff   1.9G  5 Jan 09:54 bpm.8600.cf2017.12.delta.repository.zip
-rw-r--r--  1 davidhay  staff   2.5G 26 Sep 13:25 bpm.8600.delta.repository.zip

it's interesting to note that the CF2017.12 Repo is smaller.

In terms of patching BPM, I've gone through the process a number of times now, most recently focusing upon the upgrade from 8.5.5 to 8.5.7 and 8.6.

The very short-hand version of my process follows: -

Starting Position

/opt/ibm/InstallationManager/eclipse/tools/imcl listInstalledPackages

com.ibm.cic.agent_1.8.8000.20171130_1105
com.ibm.bpm.ADV.v85_8.5.5000.20140604_1130
com.ibm.websphere.ND.v85_8.5.5002.20140408_1947


Patch WAS to 8.5.5.12

/opt/ibm/InstallationManager/eclipse/tools/imcl -input /mnt/ResponseFiles/upgradeWAS85512.rsp -acceptLicense

Updated to com.ibm.websphere.ND.v85_8.5.5012.20170627_1018 in the /opt/ibm/WebSphere/AppServer directory.
WARNING: Your default Java SDK is Java SE 6. After April 2018, service for Java SE 6 can no longer be provided, which could expose your environment to security risks.

To stay current and reduce the risk of security exposures, update to Java SE 8 using one of the following options:
- Install WebSphere Application Server 8.5.5.11 or later with Java SE 8.
- Install the optional IBM WebSphere SDK, Java Technology Edition, Version 8 package to an existing package group that contains WebSphere Application Server Version 8.5.
- Migrate to WebSphere Application Server traditional Version 9.

Alternatively, to use Java SE 7, install the optional IBM WebSphere SDK, Java Technology Edition, Version 7 or 7.1 package to the package group that contains WebSphere Application Server Version 8.5.

Install Java 8

/opt/ibm/InstallationManager/eclipse/tools/imcl -input /mnt/ResponseFiles/installJava8.rsp -acceptLicense

Installed com.ibm.websphere.IBMJAVA.v80_8.0.4005.20170626_0627 to the /opt/ibm/WebSphere/AppServer directory.

Patch BPM

/opt/ibm/InstallationManager/eclipse/tools/imcl -input upgradeBPM855_to_86_CF201712.rsp -acceptLicense

Updated to com.ibm.bpm.ADV.v85_8.6.201712.20171211_1726 in the /opt/ibm/WebSphere/AppServer directory.

Ending Position

/opt/ibm/InstallationManager/eclipse/tools/imcl listInstalledPackages

com.ibm.cic.agent_1.8.8000.20171130_1105
com.ibm.bpm.ADV.v85_8.6.201712.20171211_1726
com.ibm.websphere.IBMJAVA.v80_8.0.4005.20170626_0627
com.ibm.websphere.ND.v85_8.5.5012.20170627_1018


Note that this ONLY focuses upon the binaries, there's also a need to: -

(a) Upgrade the BPM database schemae to support 8.6
(b) Update the WAS profiles to use Java 8 rather than Java 6 
(c) Synchronise the WAS cell

However, for me, the key thing is that I can upgrade directly from 8.5.5 to 8.6 CF2017.12, rather than having to install the "base" 8.6 CF2017.09 update ( this is how 8.6 was first shipped in September 2017 ).

From this: -


To install this upgrade, you must have Version 8.5.0.0, Version 8.5.0.1, Version 8.5.0.2, Version 8.5.5.0, Version 8.5.6.0, Version 8.5.6.0 CF01, Version 8.5.6.0 CF02, Version V8.5.7.0, Version 8.5.7 CF2016.06, Version 8.5.7 CF2016.09, Version 8.5.7 CF2016.12, Version 8.5.7 CF2017.03, Version 8.5.7 2017.06, or Version 8.6 of IBM Business Process Manager Express, IBM Business Process Manager Standard, IBM Business Process Manager Advanced, or IBM Business Process Manager Advanced - Process Server, IBM Business Process Manager Express Server, or IBM Business Process Manager Server installed.

Monday, 22 January 2018

IBM Integration Bus - Wrangling permissions to the Web UI

Having built an IBM Integration Bus (IIB) 9 environment, with IBM MQ 8, I was trying ( and failing ) to access the Web UI on: -


I was instead seeing: -


The logged-on user ID does not have the required permissions to access data or broker resources in the web user interface. See your broker administrator to set up the required permissions.

I realised that I'd not yet set up a user/password, which I thus did: -

mqsiwebuseradmin IB9NODE -c -u wmbadmin1 -r wmbadmin1 -a wmbadmin1pw

Alas, this failed with: -

BIP1046E: Unable to connect with the queue manager (The user 'wmbadmin' is not authorized to connect to queue manager 'IB9QMGR' (MQ reason code 2035 while trying to connect)). 

The utility encountered a problem while attempting to connect to the queue manager to put a message to the broker's request queue. 

Ensure that the correct connection parameters have been supplied to the utility. Also ensure that the queue manager is running and that the current user is able to access the queues beginning SYSTEM.BROKER. If this error text includes an MQ reason code, look up the meaning behind the error in the Application Programming Reference guide and proceed as appropriate.

and, in the MQ Queue Manager logs: -

tail -f /var/mqm/qmgrs/IB9QMGR/errors/AMQERR01.LOG

...
22/01/18 20:28:37 - Process(67445.35) User(wmbadmin) Program(amqzlaa0)
                    Host(bpm86.uk.ibm.com) Installation(Installation2)
                    VRMF(8.0.0.0) QMgr(IB9QMGR)
                   
AMQ5534: User ID 'wmbadmin' authentication failed

EXPLANATION:
The user ID and password supplied by 'mqsiwebuseradmi' could not be
authenticated.
ACTION:
Ensure that the correct user ID and password are provided by the application.
Ensure that the authentication repository is correctly configured. Look at
previous error messages for any additional information.
----- amqzfuca.c : 4242 -------------------------------------------------------
22/01/18 20:28:37 - Process(67445.35) User(wmbadmin) Program(amqzlaa0)
                    Host(bpm86.uk.ibm.com) Installation(Installation2)
                    VRMF(8.0.0.0) QMgr(IB9QMGR)
                   
AMQ5542: The failed authentication check was caused by the queue manager
CONNAUTH CHCKLOCL(OPTIONAL) configuration.

EXPLANATION:
The user ID 'wmbadmin' and its password were checked because the queue manager
connection authority (CONNAUTH) configuration refers to an authentication
information (AUTHINFO) object named 'SYSTEM.DEFAULT.AUTHINFO.IDPWOS' with
CHCKLOCL(OPTIONAL). 

This message accompanies a previous error to clarify the reason for the user ID
and password check.
ACTION:
Refer to the previous error for more information. 

Ensure that a password is specified by the client application and that the
password is correct for the user ID. The authentication configuration of the
queue manager connection determines the user ID repository. For example, the
local operating system user database or an LDAP server. 

If the CHCKCLNT setting is OPTIONAL, the authentication check can be avoided by
not passing a user ID across the channel. For example, by omitting the MQCSP
structure from the client MQCONNX API call. 

To avoid the authentication check, you can amend the authentication
configuration of the queue manager connection, but you should generally not
allow unauthenticated remote access.
———————————————————————————————————————


I've seen, and reported upon, this before: -


I validated the CHCKCLNT setting: -

runmqsc IB9QMGR

display qmgr connauth

   QMNAME(IB9QMGR)                      
   CONNAUTH(SYSTEM.DEFAULT.AUTHINFO.IDPWOS)


display AUTHINFO(SYSTEM.DEFAULT.AUTHINFO.IDPWOS)

   AUTHINFO(SYSTEM.DEFAULT.AUTHINFO.IDPWOS)
   AUTHTYPE(IDPWOS)                        ADOPTCTX(NO)
   DESCR( )                                CHCKCLNT(REQDADM)
   CHCKLOCL(OPTIONAL)                      FAILDLAY(1)
   ALTDATE(2018-01-22)                     ALTTIME(20.26.21)


and then updated it: -

ALTER AUTHINFO(SYSTEM.DEFAULT.AUTHINFO.IDPWOS) AUTHTYPE(IDPWOS) CHCKCLNT(REQDADM) CHCKLOCL(NONE)    

REFRESH SECURITY TYPE(CONNAUTH)

This time around, the mqsiwebuseradmin command worked as expected: -

mqsiwebuseradmin IB9NODE -c -u wmbadmin1 -r wmbadmin1 -a wmbadmin1pw

BIP8071I: Successful command completion.

and I was able to access the Web UI: -


which is nice :-)

BIP4516S: Failed to find all the required WebSphere MQ java classes. Class 'com.ibm.mq.MQException' not found in CLASSPATH

I saw this today: -

BIP4516S: Failed to find all the required WebSphere MQ java classes. Class 'com.ibm.mq.MQException' not found in CLASSPATH '/opt/ibm/mqm/java/lib/com.ibm.mqjms.jar:/opt/ibm/mqm/java/lib/connector.jar:/opt/ibm/mqm/java/lib/com.ibm.mq.pcf.jar:/opt/ibm/mqm/java/lib/com.ibm.mq.jmqi.jar:/opt/ibm/mqm/java/lib/com.ibm.mq.jar:/opt/ibm/mqm/java/lib/com.ibm.mq.headers.jar:/opt/ibm/mqm/java/lib/com.ibm.mq.commonservices.jar:/opt/ibm/mqm/java/lib/com.ibm.mq.jms.Nojndi.jar:/opt/ibm/mqsi/9.0.0.2/messages:/opt/ibm/mqsi/9.0.0.2/classes:/opt/ibm/mqsi/9.0.0.2/classes/ConfigManagerProxy.jar:/opt/ibm/mqsi/9.0.0.2/classes/brokerutil.jar:/var/mqsi/common/wsrr'. 

Not all the WebSphere MQ jars are installed on this machine. Message Broker requires that WebSphere MQ for Java is installed to work correctly. 

Make sure that all the correct WebSphere MQ components are installed and that the CLASSPATH correctly contains the WebSphere MQ jar files.


when attempting to drive IBM Integration Bus (IIB) 9: -

mqsilist 

Whilst I had installed IBM MQ 8: -

/mnt/IIB9/mqlicense.sh -accept
rpm -ivh --prefix /opt/ibm/mqm /mnt/IIB9/MQSeriesRuntime-8.0.0-0.x86_64.rpm
rpm -ivh --prefix /opt/ibm/mqm /mnt/IIB9/MQSeriesServer-8.0.0-0.x86_64.rpm 


I'd forgotten to install the requisite Java runtime: -

rpm -ivh --prefix /opt/ibm/mqm /mnt/IIB9/MQSeriesJRE-8.0.0-0.x86_64.rpm 
rpm -ivh --prefix /opt/ibm/mqm /mnt/IIB9/MQSeriesJava-8.0.0-0.x86_64.rpm 


Can you say "Doh" ?

IBM BPM Upgrade - String to Boolean - What's going wrong ?

I've been seeing this repeatedly over the past few weeks, as I test various combinations of upgrades, from IBM BPM 8.5.5 to 8.5.7 or 8.6: -


with the corresponding exception in SystemOut.log: -

[04/01/18 20:27:18:401 GMT] 000001a6 BPDInstanceDA E   CWLLG0323E: An exception occurred in saveSearchableValues, reason:java.lang.ClassCastException: java.lang.String incompatible with java.lang.Boolean.
                                 java.lang.ClassCastException: java.lang.String incompatible with java.lang.Boolean

In brief, this occurs when I do the following: -
  • Install IBM BPM 8.5.5
  • Start the Deployment Environment
  • Log into Process Portal
  • Start a new instance of the sample Standard HR Open New Position Process Application, and complete ONE task
  • Shut down BPM 8.5.5
  • Upgrade to 8.5.7 or 8.6 ( including the mandatory DBUpgrade task )
  • Start the Deployment Environment
  • Log into Process Portal
  • Attempt to resume/complete the second task of the Standard HR Open New Position process
For the record, this occurs whether I perform an in-place upgrade ( where one installs the 8.5.7 or 8.6 Delta Fixpack on top of 8.5.5 ) or a side-by-side upgrade ( where one uses an export of the original 8.5.5 Deployment Environment configuration and a cloned copy of the BPM databases to build a new 8.5.7 or 8.6 target environment ).

I checked the source 8.5.5 environment, and noted that the original Business Object parameter was a Boolean: -


but that it magically became a String in 8.6: -


After much faffing about, and thanks to the support of an awesome world-wide technical team, I realised the error of my ways.

The problem occurs because I'm running my tests using a Process Center ( development/deployment environment ) rather than a Process Server ( run-time environment ).

In brief, this occurs because the original Process Application ( PA ) on the source 8.5.5 Process Center was based upon the so-called Tip, which is the first "cut" of the application, rather than a snapshot ( which is taken before an application is deployed into a target Process Server, whether for test or production ).

When I upgraded my Process Center from 8.5.5 to 8.5.7 or 8.6, the Tip has changed ( because IBM created a new version of the Standard HR Open New Position Process Application ), and we now face the issue where the Business Object in the original Tip was using one data type ( String ) whereas the Business Object in the new Tip is using a different data type ( Boolean ).

BPM can't handle this - we don't have a snapshot, we only have the Tip, and yet the Business Objects are vastly different.

That's why the exception occurs.

When I redid my tests, upgrading an 8.5.5 Process Server to 8.6, with the same situation as before i.e. a running instance of the Standard HR Open New Position process, with an outstanding task, all works as one would expect.

So that's all good then …..

Friday, 19 January 2018

IBM BPM - Tinkering with Process Application Exports and Imports

In the context of an IBM BPM migration document, I'm just making a few notes about the export of a BPM Process Application snapshot from a Process Center, ready for an offline deployment to a different ( and unconnected ) Process Server.

Which is nice :-)

On the source Process Center

Connect to the AppCluster SOAP Endpoint

/opt/ibm/WebSphereProfiles/Dmgr01/bin/wsadmin.sh -lang jython -port 8880 -user wasadmin -password passw0rd

WASX7209I: Connected to process "AppClusterMember1" on node Node1 using SOAP connector;  The type of process is: ManagedProcess
WASX7031I: For help, enter: "print Help.help()"

List Available Process Applications

print AdminTask.BPMListProcessApplications()

Containers: 
Name: System Data
Acronym: TWSYS
Description: IBM BPM System Data
Toolkit: true

Name: System Governance
Acronym: TWSYSG
Description: IBM BPM Governance Data and Services
Toolkit: true

Name: Coaches
Acronym: SYSC
Description: IBM BPM System Coaches
Toolkit: true

Name: Content Management
Acronym: SYSCM
Description: IBM BPM Content Management Data, Services and Coach views.
Toolkit: true

Name: Dashboards
Acronym: SYSD
Description: IBM BPM System Dashboards
Toolkit: true

Name: SAP Guided Workflow
Acronym: SGW
Description: Toolkit of SAP Guided Workflow
Toolkit: true

Name: Process Portal
Acronym: TWP
Description: 
Toolkit: false

Name: Saved Search Admin
Acronym: SSA
Description: Dashboard for creating and managing Saved Searches
Toolkit: false

Name: Hiring Sample
Acronym: HSS
Description: Hiring Sample
Toolkit: false

Name: Hiring Sample Advanced
Acronym: HSAV1
Description: 
Toolkit: false

Name: Procurement Sample
Acronym: STPPS1
Description: 
Toolkit: false

Drill into the details of the target PA

print AdminTask.BPMShowProcessApplication('[-containerAcronym HSS]')

Name: Hiring Sample
Acronym: HSS
Description: Hiring Sample
Toolkit: false
Tracks:

Track Name: Main
Track Acronym: Main
Default: true

Tip: 
Created On: 2018-01-19 16:29:26.083
Created By: User.9
State: State[Inactive]
Capability: Capability[Standard]
No of running instances: 0

List of Snapshots: 
Name: Standard Hiring Sample v8550
Acronym: SHSV855
Created On: 2018-01-19 16:29:26.083
Created By: User.9
Is Default: false
State: State[Inactive]
Capability: Capability[Standard]
No of running instances: 0


List the Process Servers ( the subsequent command requires a server name, even if it's an unconnected Process Server )

print AdminTask.BPMListServers()

Servers:
Name: DMH
URL: jnp://XXXXX:XXXX

Create an Offline Package, ready for export

AdminTask.BPMCreateOfflinePackage('[-containerAcronym HSS -containerSnapshotAcronym SHSV855 -containerTrackAcronym Main -serverName DMH]')

'BPMCreateOfflinePackage passed.'

Export the Process Application snapshot

AdminTask.BPMExtractOfflinePackage('[-containerAcronym HSS -containerSnapshotAcronym SHSV855 -containerTrackAcronym Main -serverName DMH -outputFile /mnt/Apps/StandardHiringSamplev8550.zip]')

'BPMExtractOfflinePackage passed.'

Validate the export

ls -al

total 5368
drwxr-xr-x   4 davidhay  staff      136 19 Jan 17:46 .
drwxr-xr-x  22 davidhay  staff      748  9 Jan 16:36 ..
-rw-r--r--   1 davidhay  staff  1243529  3 Nov 19:22 BAMTST_V4.zip
-rw-r--r--   1 davidhay  staff  1501656 19 Jan 17:46 StandardHiringSamplev8550.zip

On the target Process Server

Connect to the AppCluster SOAP Endpoint

/opt/ibm/WebSphereProfiles/Dmgr01/bin/wsadmin.sh -lang jython -port 8880 -user wasadmin -password passw0rd

WASX7209I: Connected to process "AppClusterMember1" on node Node1 using SOAP connector;  The type of process is: ManagedProcess
WASX7031I: For help, enter: "print Help.help()"

AdminTask.BPMInstallOfflinePackage('[-inputFile /mnt/Apps/StandardHiringSamplev8550.zip]')

'BPMInstallOfflinePackage passed.'

List Available Process Applications

print AdminTask.BPMListProcessApplications()

Containers: 
Name: System Data
Acronym: TWSYS
Description: IBM BPM System Data
Toolkit: true

Name: System Governance
Acronym: TWSYSG
Description: IBM BPM Governance Data and Services
Toolkit: true

Name: Coaches
Acronym: SYSC
Description: IBM BPM System Coaches
Toolkit: true

Name: Content Management
Acronym: SYSCM
Description: IBM BPM Content Management Data, Services and Coach views.
Toolkit: true

Name: Dashboards
Acronym: SYSD
Description: IBM BPM System Dashboards
Toolkit: true

Name: SAP Guided Workflow
Acronym: SGW
Description: Toolkit of SAP Guided Workflow
Toolkit: true

Name: Process Portal
Acronym: TWP
Description: 
Toolkit: false

Name: Saved Search Admin
Acronym: SSA
Description: Dashboard for creating and managing Saved Searches
Toolkit: false

Name: Hiring Sample
Acronym: HSS
Description: 
Toolkit: false


print AdminTask.BPMShowProcessApplication('[-containerAcronym HSS]')

Name: Hiring Sample
Acronym: HSS
Description: 
Toolkit: false
Tracks:

List of Snapshots: 
Name: Standard Hiring Sample v8550
Acronym: SHSV855
Created On: 2018-01-19 20:44:18.822
Created By: User.1
Is Default: true
State: State[Active]
Capability: Capability[Standard]
No of running instances: 0

In addition, validatory messages can be seen in AppCluster SystemOut.log e.g.

[19/01/18 20:44:16:768 GMT] 00000195 PALAdminComma I PALAdminCommands processServerOfflineDeploy Entering
[19/01/18 20:44:18:192 GMT] 00000195 wle           I   CWLLG3547I: Process Application: Hiring Sample, Snapshot: Standard Hiring Sample v8550 : The snapshot with ID Snapshot.aaa569e9-a57a-4684-b357-34237e4e49ea is being installed. The following toolkits are being installed: []
[19/01/18 20:44:18:212 GMT] 00000195 wle           I   CWLLG3533I: Process Application: Hiring Sample, Snapshot: Standard Hiring Sample v8550 : The snapshot is being imported.
[19/01/18 20:44:24:178 GMT] 00000195 wle           I   CWLLG3534I: Process Application: Hiring Sample, Snapshot: Standard Hiring Sample v8550 : The snapshot was successfully imported.
[19/01/18 20:44:24:178 GMT] 00000195 wle           I   CWLLG3536I: Process Application: Hiring Sample, Snapshot: Standard Hiring Sample v8550 : The installation service for the snapshot is being started.
[19/01/18 20:44:24:197 GMT] 0000019a JMSClassifica W   XJMS0021E: Unable to map destination and bus to workclass. Aborting the xd classification filter for the current request. Request context information is com.ibm.ws.xd.jms.proxy.impl.AsynchJMSServiceContextImpl@5700490c<bus=BPM.De1.Bus,destination=PortalWebMessagingTopicSpace.AppCluster>.
[19/01/18 20:44:24:231 GMT] 0000019b JMSClassifica W   XJMS0021E: Unable to map destination and bus to workclass. Aborting the xd classification filter for the current request. Request context information is com.ibm.ws.xd.jms.proxy.impl.AsynchJMSServiceContextImpl@c5fba99b<bus=BPM.De1.Bus,destination=cacheTopicDestination.AppCluster>.
[19/01/18 20:44:24:236 GMT] 0000019c JMSClassifica W   XJMS0021E: Unable to map destination and bus to workclass. Aborting the xd classification filter for the current request. Request context information is com.ibm.ws.xd.jms.proxy.impl.AsynchJMSServiceContextImpl@557e4439<bus=BPM.De1.Bus,destination=TWServerTopicDestination.AppCluster>.
[19/01/18 20:44:25:285 GMT] 00000195 wle           I   CWLLG3537I: Process Application: Hiring Sample, Snapshot: Standard Hiring Sample v8550 : The installation service for the snapshot finished successfully.
[19/01/18 20:44:25:286 GMT] 00000195 wle           I   CWLLG3539I: Process Application: Hiring Sample, Snapshot: Standard Hiring Sample v8550 : The data for the snapshot is being migrated.
[19/01/18 20:44:25:408 GMT] 00000195 wle           I   CWLLG3540I: Process Application: Hiring Sample, Snapshot: Standard Hiring Sample v8550 : The data for the snapshot was migrated successfully.
[19/01/18 20:44:25:409 GMT] 00000195 wle           I   CWLLG3541I: Process Application: Hiring Sample, Snapshot: Standard Hiring Sample v8550 : The instances of the snapshot are being migrated.
[19/01/18 20:44:25:436 GMT] 00000195 wle           I   CWLLG3542I: Process Application: Hiring Sample, Snapshot: Standard Hiring Sample v8550 : The instances of the snapshot were migrated successfully.
[19/01/18 20:44:30:683 GMT] 00000195 wle           I   CWLLG3545I: Process Application: Hiring Sample, Snapshot: Standard Hiring Sample v8550 : The tracking definitions for the snapshot were updated successfully.
[19/01/18 20:44:30:710 GMT] 00000195 wle_eventmgr  I   CWLLG3550I: Process Application: Hiring Sample, Snapshot: Standard Hiring Sample v8550 : The scheduled UCAs for the snapshot are being activated.
[19/01/18 20:44:30:880 GMT] 00000195 wle_eventmgr  I   CWLLG3551I: Process Application: Hiring Sample, Snapshot: Standard Hiring Sample v8550 : The scheduled UCAs for the snapshot were activated successfully.
[19/01/18 20:44:30:884 GMT] 00000195 wle_eventmgr  I   CWLLG3550I: Process Application: Hiring Sample, Snapshot: Standard Hiring Sample v8550 : The scheduled UCAs for the snapshot are being activated.
[19/01/18 20:44:30:884 GMT] 00000195 wle_eventmgr  I   CWLLG3551I: Process Application: Hiring Sample, Snapshot: Standard Hiring Sample v8550 : The scheduled UCAs for the snapshot were activated successfully.
[19/01/18 20:44:31:205 GMT] 00000195 wle           I   CWLLG3548I: Process Application: Hiring Sample, Snapshot: Standard Hiring Sample v8550 : The snapshot was installed successfully.
[19/01/18 20:44:31:243 GMT] 00000195 PALAdminComma I PALAdminCommands processServerOfflineDeploy Exiting




Thursday, 18 January 2018

Docker on Linux - Scripting the removal of images

I'm again going through the process to deploy IBM Cloud Private (ICP) on Ubuntu.

However, I forgot to check the available disk space …..

So, when I ran this command: -

tar xf /tmp/ibm-cloud-private-x86_64-2.1.0.1.tar.gz -O | sudo docker load

to expand the ICP tarball and load the corresponding Docker images, I ended up with: -

97f41382ba74: Loading layer [==================================================>]  4.727MB/4.727MB
Loaded image: ibmcom/vulnerability-annotator:20171011
9f17712cba0b: Loading layer [========================>                          ]  61.28MB/126.6MB
Error processing tar file(exit status 1): write /usr/lib/python2.7/pydoc_data/topics.py: no space left on device


df -kmh

Filesystem      Size  Used Avail Use% Mounted on
udev            1.9G     0  1.9G   0% /dev
tmpfs           393M  6.2M  387M   2% /run
/dev/sda1        46G   29G   15G  67% /
tmpfs           2.0G  196K  2.0G   1% /dev/shm
tmpfs           5.0M     0  5.0M   0% /run/lock
tmpfs           2.0G     0  2.0G   0% /sys/fs/cgroup
tmpfs           393M   52K  393M   1% /run/user/1000

To mitigate this, I wanted to quickly remove the Docker images, and re-do from start.

This is what I have: -

docker images

REPOSITORY                                  TAG                 IMAGE ID            CREATED             SIZE
ibmcom/icp-catalog-ui                       2.1.0.1             24cf2215580a        4 weeks ago         116MB
ibmcom/kubernetes                           v1.8.3-ee           924aee0d6910        5 weeks ago         513MB
ibmcom/icp-datastore                        2.1.0.1             1575ed9083e6        5 weeks ago         1.72GB
ibmcom/icp-platform-ui                      2.1.0.1             25e8146b6fac        5 weeks ago         153MB
ibmcom/iam-policy-decision                  2.1.0.1             ac23eb27e760        5 weeks ago         576MB
ibmcom/iam-token-service                    2.1.0.1             4da681e7e542        5 weeks ago         891MB
ibmcom/unified-router                       2.1.0.1             caf82a5f8a00        5 weeks ago         50.1MB
ibmcom/icp-platform-api                     2.1.0.1             9529dd6d9349        5 weeks ago         142MB
ibmcom/icp-identity-provider                2.1.0.1             7a8784ad58fc        5 weeks ago         164MB
ibmcom/icp-image-manager                    2.1.0.1             c05a213a80e1        5 weeks ago         25.6MB
ibmcom/icp-router                           2.1.0.1             1e2c1cc654b6        5 weeks ago         46.5MB
ibmcom/icp-platform-auth                    2.1.0.1             96e70190d588        5 weeks ago         498MB
ibmcom/icp-identity-manager                 2.1.0.1             54db055b2b1c        5 weeks ago         185MB
ibmcom/icp-helm-api                         2.1.0.1             b72c1d4155b8        5 weeks ago         139MB
ibmcom/icp-helm-repo                        2.1.0.1             2cb2b0c0ca02        5 weeks ago         98.5MB
ibmcom/metering-data-manager                2.1.0.1             01fc6bf87198        6 weeks ago         72.6MB
ibmcom/metering-server                      2.1.0.1             3401a1fe1a65        7 weeks ago         630MB
ibmcom/metering-ui                          2.1.0.1             216ae682db59        7 weeks ago         425MB
ibmcom/metering-reader                      2.1.0.1             56354bef6b82        7 weeks ago         166MB
ibmcom/usncrawler                           20171128            7f9ab5354091        7 weeks ago         481MB
ibmcom/live-crawler                         20171128            5dd18f1681db        7 weeks ago         715MB
ibmcom/sas-mgmt                             20171113            9801e6747666        7 weeks ago         519MB
ibmcom/sas-api                              20171113            750679c0c313        7 weeks ago         519MB
ibmcom/reg-crawler                          20171122            4d1991b4d0af        7 weeks ago         716MB
ibmcom/gluster                              3.12.1              0a644a8465a6        7 weeks ago         347MB
ibmcom/metrics-crawler                      20171122            f25802bd7454        8 weeks ago         715MB
ibmcom/service-catalog-service-catalog      v0.1.2              566a76042660        2 months ago        105MB
ibmcom/livescan-proxy                       20171011            1f28dd781b9a        3 months ago        418MB
ibmcom/rootkit-annotator                    20171011            e0d54f8afa6a        3 months ago        413MB
ibmcom/password-annotator                   20171011            13cbea171a66        3 months ago        1.19GB
ibmcom/compliance-annotator                 20171011            9a6812e9f19f        3 months ago        1.27GB
ibmcom/vulnerability-annotator              20171011            bca818bb6d43        3 months ago        1.26GB
ibmcom/config-parser                        20171011            b69068191cc9        3 months ago        1.22GB
ibmcom/generic-indexer                      20171011            9a03a4f3cc64        3 months ago        785MB
ibmcom/config-indexer                       20171011            6f388d467108        3 months ago        785MB
ibmcom/elasticsearch                        2.4.1-20171011      7317af2ea391        3 months ago        537MB
ibmcom/indices-cleaner                      0.2                 5e092b17e223        3 months ago        210MB
ibmcom/icp-initcontainer                    1.0.0               76da55c8019d        4 months ago        3.97MB
ibmcom/ucarp                                1.5.2               d6f29a895ed9        4 months ago        7.67MB
ibmcom/tiller                               v2.6.0              47011b53bf14        4 months ago        48.6MB
ibmcom/calico-policy-controller             v0.7.0              60d797585fc5        5 months ago        21.9MB
ibmcom/service-catalog-apiserver            v0.0.15             3a30f3472e44        5 months ago        196MB
ibmcom/service-catalog-controller-manager   v0.0.15             708755fff078        5 months ago        193MB
ibmcom/kube-state-metrics                   v1.0.0              8bbbe7eb4704        5 months ago        43.9MB
ibmcom/calico-node                          v2.4.1              7643422fdf0f        5 months ago        277MB
ibmcom/grafana                              4.4.3               49e2eb4da222        5 months ago        287MB
ibmcom/curl                                 3.6                 f73fee23ac74        5 months ago        5.35MB
ibmcom/coredns                              010                 27e7aa6e71ce        5 months ago        43.5MB
ibmcom/kibana                               5.5.1               7bf53f710f44        5 months ago        629MB
ibmcom/filebeat                             5.5.1               af80995a4fcf        5 months ago        271MB
ibmcom/logstash                             5.5.1               e8f5c2ec30f2        5 months ago        577MB
ibmcom/elasticsearch                        5.5.1               74ef44f69db6        5 months ago        544MB
ibmcom/heketi                               5                   5851537645df        5 months ago        343MB
ibmcom/alertmanager                         v0.8.0              901c70144da4        6 months ago        17.7MB
ibmcom/heapster                             v1.4.0              749531a6d2cf        6 months ago        73.4MB
ibmcom/k8s-dns-sidecar                      1.14.4              38bac66034a6        6 months ago        41.8MB
ibmcom/k8s-dns-kube-dns                     1.14.4              a8e00546bcf3        6 months ago        49.4MB
ibmcom/k8s-dns-dnsmasq-nanny                1.14.4              f7f45b9cb733        6 months ago        41.4MB
ibmcom/prometheus                           v1.7.1              4da113bb6ae3        7 months ago        74.5MB
ibmcom/etcd                                 v3.1.5              3f6d64a8fae8        8 months ago        152MB
ibmcom/node-exporter                        v0.14.0             bb4a6b774658        10 months ago       18.9MB
ibmcom/kafka                                0.10.0.1            223037679e4f        10 months ago       260MB
ibmcom/k8szk                                v2                  2fd25e05d6e2        13 months ago       284MB
ibmcom/configmap-reload                     v0.1                b70d7dba98e6        17 months ago       4.78MB
ibmcom/mariadb                              10.1.16             3b5159f610ed        18 months ago       392MB
ibmcom/registry                             2                   8ff6a4aae657        19 months ago       172MB
ibmcom/pause                                3.0                 99e59f495ffa        20 months ago       747kB

Sadly, there's no command such as: -

docker rmi —all

or similar.

So I did this: -

docker rmi `docker images | awk '{print $3}'`

which is just as good :-)

And now we're back to normal

df -kmh

Filesystem      Size  Used Avail Use% Mounted on
udev            1.9G     0  1.9G   0% /dev
tmpfs           393M  6.2M  387M   2% /run
/dev/sda1        46G   13G   31G  30% /
tmpfs           2.0G  196K  2.0G   1% /dev/shm
tmpfs           5.0M     0  5.0M   0% /run/lock
tmpfs           2.0G     0  2.0G   0% /sys/fs/cgroup
tmpfs           393M   52K  393M   1% /run/user/1000


Having moved the ICP tarball onto a different box ( NFS server ), I'm trying again ….

tar xf /mnt/ibm-cloud-private-x86_64-2.1.0.1.tar.gz -O | sudo docker load