Showing posts with label WAS-Network-Deployment. Show all posts
Showing posts with label WAS-Network-Deployment. Show all posts

Friday, November 21, 2014

ConfigEntine task "wp-create-ldap" failed with SOAP connector problem.

[timestamp] ssl.default.password.in.use.CWPKI0041W
[timestamp] ssl.disable.url.hostname.verification.CWPKI0027I
[timestamp] Client code attempting to load security configuration
[timestamp] ssl.certificate.end.date.invalid.CWPKI0312E
Could not access WebSphere profile using: username=wpsadmin password=PASSWORD_REMOVED portNumber=10025 hostname=myportalserver.ibm.com
com.ibm.websphere.management.exception.ConnectorException: ADMC0016E: The system cannot create a SOAP connector to connect to host myportal.mycompany.com at port 10025.
at com.ibm.websphere.management.AdminClientFactory.createAdminClientPrivileged(AdminClientFactory.java:628)
at com.ibm.websphere.management.AdminClientFactory.access$000(AdminClientFactory.java:122)
...
Caused by: java.lang.reflect.InvocationTargetException
...
Caused by: com.ibm.websphere.management.exception.ConnectorNotAvailableException: [SOAPException: faultCode=SOAP-ENV:Client; msg=Error opening socket: javax.net.ssl.SSLHandshakeException: com.ibm.jsse2.util.g: PKIX path validation failed: java.security.cert.CertPathValidatorException: The certificate expired at Fri Aug 19 05:01:01 EDT 2011; internal cause is:
java.security.cert.CertificateExpiredException: NotAfter: Tue Oct 01 05:01:01 EDT 2014;

Using wsadmin to connect the server with type SOAP, the same exceptions prevented the correct connection.

Cause

The default chained certificate has problems.

Resolving the problem

In WebSphere Application Server (WAS) version 7, a default chained certificate was introduced as a personal certificate. This certificate was created during profile set up and should be valid for a year. It should be renewed when its validity date expires.
When running ConfigEngine, it acts as a client that connects to the server through SOAP connector. It takes the parameters configured in /properties/ssl.client.props that points to the key store file containing the default personal certificate and residing at /etc/key.p12.
To renew the certificate, take the following steps
- Log in to the Integrated Solutions Console as the primary WAS administrative user;
- Navigate to Security > SSL certificate and key management > Key stores and certificates > NodeDefaultKeyStore> Personal certificates;
- Check the box besides "Default", and hit button "Renew". You should see the expiration date now is updated for another year.
- Restart servers.

Wednesday, November 5, 2014

Troubleshooting WebSphere Application Server issues in Sametime Advanced 8

Where to look for errors (SystemOut, SystemErr, ffdc)
Logging/tracing usually found in /WebSphere/AppServer/profiles/profile_name/logs/. See Logging and tracing at the Info Center.

Server logs: 
Look in system error logs, found in /WebSphere/AppServer/profiles/profile_name/logs/server1/SystemErr.log
Look in system out logs, found in /WebSphere/AppServer/profiles/profile_name/logs/server1/SystemOut.log
ffdc logs: 
Look in ffdc logs, found in /WebSphere/AppServer/profiles/profile_name/logs/ffdc

How to look for CPU heap issues for WAS

To dump the javacore and/or heapdump on WebSphere:

(start the wsadmin console... you'll be prompted for login/pwd credentials...)
cd \ProgramFiles\IBM\WebSphere\AppServer\bin
wsadmin

(setup for the DUMPS... specifying application server to dump...)
wsadmin> set jvm [$AdminControl completeObjectName type=JVM,process=server1,*]

(when ready to dump... execute the following to get a javacore file...)
wsadmin> $AdminControl invoke $jvm dumpThreads

OR

(when ready to dump... execute the following to get a heapdump file...)
wsadmin> $AdminControl invoke $jvm generateHeapDump

javacore/heapdump file will be in the following directory:
\ProgramFiles\IBM\WebSphere\AppServer\profiles\ST_Advanced_Profile

How to monitor CPU for WebSphere Application Servver
See How to monitor CPU for EB.

How to turn on tracing


You can find on the following page Setting a diagnostic trace on a serverexternal link how to turn on tracing for the following:
  • How to turn on logging when looking for persistent chat errors
  • How to turn on logging when looking for vmm/ldap errors
  • How to turn on logging when looking for skilltap errors
How to turn on logging when looking for db errors:
Choose this detail level com.ibm.workplace.db.persist.

How to turn on tracing for vmm issues
To look for issues with ldap we will need to enabled wmm tracing. In the admin console, turn on tracing for "com.ibm.websphere.wim.=all:com.ibm.ws.wim.=all:com.ibm.wsspi.wim.*=all" at level FINEST. You should then see a trace.log file (where system.out and system.err live) with this tracing inside.

How to turn on Performance Monitoring Infrastructure PMI


Something to read before setting up:

This is a good page for reading on what to monitor when using PMI Monitoring overall system healthexternal link

Setting it up:
  1. In WebSphere ISC Console, go to Monitoring and Tuning - Performance Monitoring Infrastructure (PMI).
  2. Click server1.
  3. Enable either "Basic" monitoring or "Custom".

Basic monitoring should provide us with the 3 things we are interested in:
  • Number of DB Connections
  • Number of JMS Connections
  • Number of HTTP Sessions

If you are going to do "Custom" monitoring, enable the following statistics to get # of DB/JMS/HTTP connections/sessions: JDBC Connection Pools.CreateCount, JCA Connection Pools.CreateCount, Servlet Session Manager.LiveCount.

Once PMI is enabled you can look at the "Current Activity. To do this:
  1. In WebSphere ISC Console, go to Monitoring and Tuning - Performance Monitoring Infrastructure (PMI).
  2. Click Performance Viewer.
  3. Click Current Activity.
  4. Click server1.

From here on you can click on Summary Reports or Performance Modules which is more fine-grained. In Performance Modules, you can select the 3 statistics we are interested in. The picture below shows how to expand the trees and select the appropriate statistics.




Besides looking at Current Activity, you can View Logs. This option should be in the same location as Current Activity. Click View Logs and browse to the Server File where the PMI logs are saved. This location is usually: WAS\AppServer\profiles\AppSrv01\logs\tpv\


Adding WebSphere Application Servver as a Windows service



1. Modify IBM\was\AppServer\profiles\ST_Advanced_Profile\properties\soap.client.props file so you can stop Lotus Sametime Advanced with specifying a user name and passord. For example:


#------------------------------------------------------------------------------
# SOAP Client Security Enablement
#
# - security enabled status  ( false[default], true  )
#------------------------------------------------------------------------------ 
com.ibm.SOAP.securityEnabled=true  
com.ibm.SOAP.loginUserid=wasadmin 
com.ibm.SOAP.loginPassword=mypassword
#------------------------------------------------------------------------------


2. Configure WebSphere Application Servver to start as a service. User ID must have local security rights. Use the following syntax:


WASService.exe -add "service_name"
               -serverName server
               -profilePath server_profile_directory

For example:
D:\IBM\WAS\AppServer\bin\WASService -add "SametimeAdvanced" -serverName server1
   -profilePath "d:\ibm\was\AppServer\profiles\ST_Advanced_Profile"
   -startType automatic


3. Go to Click Start - Control Panel - Double-click Administrative Tools - Double-click Services. You should see IBM WebSphere Application Server V6.1 - node-name. which is the windows service you just created.

Note: To remove the service, type WASService.exe -remove"service_name" from WAS\bin\.

Source : http://www-10.lotus.com/ldd/stwiki.nsf/dx/Debug_Sametime_Advanced_WebSphere_Problems

WebSphere Application Server - Quick How To


A quick list of "Good to Knows":
  • What is the default URL of the admin console: https://$hostname:10003/ibm/console/logon.jsp
  • What are the default ports: HTTP: 8080, HTTPS: 443.
  • How to locate the logs: Logs can be found under$install_root/profiles/$profile_name/logs/$server_name. The default profile name is AppSrv01 and the default server name is server1. Example:/usr/IBM/WebSphere/AppServer/profiles/AppSrv01/logs/server1. SystemOut.log is the file containing everything that was logged to standard out. Logs can also be viewed from the admin console by navigating to Troubleshooting/Logging and Tracing/server_name/Runtime.
  • How to start/stop a server: If you're dealing with a "Network Deployment" type of installation (multiple application servers running under the control of the "deployment manager"), your can start/stop a server from the console (Server/Server Types/WebSphere application servers). Otherwise you have to do it from command line. Go to install_root/bin and run./startServer.sh server_name, e.g., ./startServer.sh server1 (this assumes that your installation has only one profile defined, otherwise you may need to "cd" to the profile_name/bindirectory). Make sure that you run all commands using the appropriate system account. To stop the server, run ./stopServer.sh server_name -username user_name -password password. user_name and password is the credentials of an admin account, typically the same one you use to login to the console.
  • How to deploy an application: In admin console, navigate to Applications/Application Types/WebSphere enterprise applications, click on "Install new application", select "Fast path", accept all the defaults except that on "step 2" make sure that you targeted correct servers (if you have multiple servers/clusters in your environment). Note that you can deploy a WAR file directly, you don't have to build an EAR. In this case, make sure that you set a context root on "step 4" screen of the wizard.
  • How to change context root of a Web application: Go to Applications/Application Types/WebSphere enterprise applications/application_name/Context Root For Web Modules in the console. Re-start the application after the change.
  • How to change the order of classloaders: If you're getting a ClassNotFoundException when you're starting the app, changing the order of classloaders is the first thing you may want to try. Go to Applications/Application Types/WebSphere enterprise applications/application_name/Manage Modules/module_name and make the appropriate selection in the "Class loader order" drop-down (this assumes you're doing it for a WAR module).
  • How to enable dynamic class reloading: If you need to frequently update your deployed application (e.g., you use a local WAS installation for development), enabling dynamic reloading could be a huge time saver. Go to your application in the console, "Class loading and update detection", set "Override class reloading settings ..." and set polling interval to 2 seconds. See this post for more details on how to configure your development environment to support class reloading.
  • How to find a host name and a port of the server: Go to Server/Server Types/WebSphere application servers. You'll find the host name in the Host Name column. To find a port, click on your server, and expand Ports. WC_defaulthost is the HTTP port and WC_defaulthost_secure is the HTTPS port.
  • How to kill a JVM: If the normal "stop" routine failed to stop the server in a reasonable amount of time, you may need to kill it. In a "Network Deployment" environment, simply navigate to the list of servers, select the server and click "Terminate". A node agent will kill the JVM for you. To achieve the same from command line (the only option if you're running standalone), cd toinstall_root/profiles/profile_name/logs/server_name, and kill the process ID contained in the file server_name.pid. On Unix, you can simply do kill -9 `cat server1.pid` (assumingserver1 is your server name). Use task manager or taskkill /PID on Windows.
  • How to browse JMS messages: Go to Buses/Your bus name/Destinations/Your destination/Queue points/Your queue point/Runtime/Messages.
  • Where to find configuration files: WAS has many configuration files, most of them are in XML/XMI format. The files are located under$install_root/profiles/$profile_name/config/cells/$cell_name.

Tuesday, July 8, 2014

THE DEFAULT SETTINGS FOR JVM HEAP SIZE MAY NOT BE ADEQUATE FOR LARGE ENVIRONMENTS

By default, we set the Maximum Heap size to 1024.

This may cause a problem with memory available to WAS:

Exceptions visible in the logs:

2012/05/30 11:30:47:545 CAT] 00000016 TimerImpl     E ASYN0012E:  Alarm/Timer threw exception commonj.work.WorkCompletedException: java.lang.RuntimeException: java.lang.OutOfMemoryError
Caused by: java.lang.OutOfMemoryError  at java.lang.String.(String.java:365) at com.ibm.license.mgmt.dao.ProductReplacementDAO$ReplacingBranchVO.depure(Unknown Source)  at com.ibm.license.mgmt.dao.ProductReplacementDAO$ReplacingBranchVO.(Unknown Source)  at com.ibm.license.mgmt.dao.ProductReplacementDAO.getBranch(Unknown Source)

This may happen during aggregation, catalog import,recalculation.

Local fix
a) increase the WebSphere JVM memory, by navigating  from Tivoli
Integrated Portal to  > Settings > WebSphere Administrative Console > Launch console

 > In the WebSphere web console, select Servers -> Server Types

WebSphere application servers -> Server Infrastructure -> Java and Process Management -> Process definition

 > In Additional Properties section, select Java Virtual Machine

 > In General Properties section, increase the values for "Initial heap size" and for "Maximum heap size".

b) restart the server

In some cases reverting aggregation process may be necessary.

source : http://www-01.ibm.com/support/docview.wss?uid=swg1IV22047


Monday, November 4, 2013

IBM HTTP Server (IHS) - Installing it Silently on AIX

1) Create logical file system /IBM (or other name)
2) Download the following installation files from IBM WebSite - C1G2NML.tar.gz (WebSphere Supplements installation media)
3) Download the following FixPack files from IBM website.

Fixpacks
7.0.0-WS-IHS-AixPPC32-FP0000017.pak
7.0.0-WS-PLG-AixPPC32-FP0000017.pak

4) install IHS silently with root user
- Log on the server as root
- In /IBM/IHS7
gunzip C1G2NML.tar.gz
tar –xvf C1G2NML.tar
- Go to directory /IBM/IHS7/IHS
- Run command “cp responsefile.txt responsefile.txt.bak”
- Edit responsefile.nd.txt and set the following value
-OPT silentInstallLicenseAcceptance=”true”
-OPT allowNonRootSilentInstall=false
-OPT installLocation=”/IBM/HTTPServer”
-OPT createAdminAuth=”true”
-OPT adminAuthUser=”ihsadmin”
-OPT adminAuthPassword=”ihsadmin”
-OPT adminAuthPasswordConfirm=”ihsadmin”
-OPT runSetupAdmin=”true”
-OPT createAdminUserGroup=true
-OPT setupAdminUser=”ihsadmin”
-OPT setupAdminGroup=”ihsgroup”
-OPT washostname=”remote_was_host”
Uncomment the following options
-OPT disableOSPrereqChecking=”true”
And comment all others options
- Run the following command to install IHS7.0 server :
./install -options “responsefile.txt” -silent

See the log files in "/ihslogs/" for the installation status.

- After installation, go to directory /IBM/HTTPServer/bin, and check IHS version using “versionInfo.sh”, we will see the version of HTTP Server is 7.0.0.0, go to directory /IBM/HTTPServer/Plugins/bin, and check WebSphere Plugins version using “versionInfo.sh”, we will see the version of WebSphere Plugins version is 7.0.0.0

5)     Install Update Installer 7.0.0.17 on the server

- Go to Directory /IBM/UPDI/
- Run the command “gunzip 7.0.0.17-WS-UPDI-AixPPC32.tar.gz” and “tar –xvf 7.0.0.17-WS-UPDI-AixPPC32.tar”
- Go to Directory /IBM/cd_software/UPDI/UpdateInstaller
- Run the command “cp responsefile.updiinstaller.txt  responsefile.updiinstaller.txt.bak”
- Edit the file “responsefile.updiinstaller.txt” and set the following value
-OPT silentInstallLicenseAcceptance=”true”
-OPT installLocation=”/IBM/WebSphere/UpdateInstaller”
Uncomment the following options
-OPT disableOSPrereqChecking=”true”
-OPT disableEarlyPrereqChecking=”true”
Comment all other options
- Run the command “./install -options “responsefile.updiinstaller.txt” –silent” to install update installer

- Go to Directory /IBM/WebSpehre/UpdateInstaller to check Update Installer version, it should be “7.0.0.17 6) Install IHS and WebSphere Plugins fixpacks using Update Installer
- Go to Directory /IBM/WebSphere/UpdateInstaller/responsefiles
- Run the command “cp install.txt installIHS.txt” and “cp install.txt installPLG.txt”
- Edit installIHS.txt as the following:
-W maintenance.package=”/IBM/fixpack/7.0.0-WS-IHS-AixPPC32-FP0000017.pak”
-W product.location=”/IBM/HTTPServer”
- Edit installPLG.txt as the following:
-W maintenance.package=”/IBM/fixpack/7.0.0-WS-PLG-AixPPC32-FP0000017.pak”
-W product.location=”/IBM/HTTPServer/Plugins”
- Go to Directory /IBM/WebSphere/UpdateInstaller/bin, run the following command to apply the fixpacks
./update.sh -options responsefiles/installIHS.txt –silent
./update.sh -options responsefiles/installPLG.txt –silent

Monitor /IBM/WebSphere/UpdateInstaller/logs/tmp/updatelog.txt for updating status.

- Go to Directory /IBM/HTTPServer/bin and /IBM/HTTPServer/Plugins/bin, run the command “versionInfo.sh” to check that both version should be 7.0.0.17.
-  After installation, go to /IBM, run the following command to grant the permission
“chmod –fR 755 /IBM/HTTPServer”, “chown –fR wasuser:wasgroup /IBM/HTTPServer”
- Go to /IBM/HTTPServer/conf, edit httpd.conf and update the following values
User wasuser
Group wasgroup

- Go to /IBM/HTTPServer/bin, and run “adminctl start” and “apachectl –k start” to start IHS server.

WAS 7 ND - INSTCONFFAILED : NONROOT_INSTALL_DISALLOWED

Error located in the installation log (/ihslogs/) file for a WAS 7ND installation using a response file.

(04-Nov-2013 13:05:17), Process, com.ibm.ws.install.ni.ismp.actions.ISMPLogFileAction, msg1, ********************************************************************************
(04-Nov-2013 13:05:17), Process, com.ibm.ws.install.ni.ismp.actions.ISMPLogFileAction, msg1, Starting a new installation or uninstallation procedure.
(04-Nov-2013 13:05:17), Process, com.ibm.ws.install.ni.ismp.actions.ISMPLogFileAction, msg1, ********************************************************************************
(04-Nov-2013 13:05:17), Process, com.ibm.ws.install.ni.ismp.actions.ISMPLogFileAction, msg1, Java Install Path: /opt/IBM/ITM/WebSphere/installs/WAS70/JDK/jre.pak/repository/package.java.jre/java/jre
(04-Nov-2013 13:05:17), Process, com.ibm.ws.install.ni.ismp.actions.ISMPLogFileAction, msg1, OS Name: AIX
(04-Nov-2013 13:05:17), Process, com.ibm.ws.install.ni.ismp.actions.ISMPLogFileAction, msg1, OS Architecture: ppc64
(04-Nov-2013 13:05:17), Process, com.ibm.ws.install.ni.ismp.actions.ISMPLogFileAction, msg1, OS Version: 6.1
(04-Nov-2013 13:05:17), Process, com.ibm.ws.install.ni.ismp.actions.ISMPLogFileAction, msg1, Current User ID: wasadmin
(04-Nov-2013 13:05:17), Process, com.ibm.ws.install.ni.ismp.actions.ISMPLogFileAction, msg1, Current User Home: /home/wasadmin
(04-Nov-2013 13:05:17), Process, com.ibm.ws.install.ni.ismp.actions.ISMPLogFileAction, msg1, Current Working Directory: /opt/IBM/ITM/WebSphere/installs/WAS70/WAS
(04-Nov-2013 13:05:17), Process, com.ibm.ws.install.ni.ismp.actions.PopulateTitleBarAction, msg1, IBM WebSphere Application Server 7.0
(04-Nov-2013 13:05:17), Process, com.ibm.ws.install.ni.ismp.actions.ISMPFileDeleteAction, msg1, Deleting file: Source: /tmp/.aix_ISMP_lock____
(04-Nov-2013 13:05:17), Process, com.ibm.ws.install.ni.ismp.actions.ISMPWarningDialogAction, wrn, INSTCONFFAILED : NONROOT_INSTALL_DISALLOWED : Set the non-root install allowed setting to true in the response file before installing.
Correct the specification to proceed.
(04-Nov-2013 13:05:17), Process, com.ibm.ws.install.ni.ismp.actions.SettleNIFRegistryAction, msg1, Current install/uninstall process failed.
(04-Nov-2013 13:05:17), Process, com.ibm.ws.install.ni.ismp.actions.SetExitCodeAction, msg1, CWUPI0000I: EXITCODE=1
(04-Nov-2013 13:05:17), Process, com.ibm.ws.install.ni.ismp.actions.ISMPLogSuccessMessageAction, msg1, INSTCONFFAILED



Solving the Problem:

Edit your reponse file and add the follownig entry

-OPT allowNonRootSilentInstall=”true

Generate reports from Opportunities using a Visualforce Page in Salesforce

  Step 1: Create a Visualforce Page Go to the Setup menu in Salesforce. Search for "Visualforce Pages" in the Quick Find box and c...