Stephen Weblog

The significant architecture changes from 11.1.1.3 to 11.1.2 are:

WebLogic has replaced Apache Tomcat as the embedded application server for all EPM Web
applications.

The default Web server for front-ending all applications is Oracle HTTP Server (OHS)
instead of Apache.

Shared Services and EPM Workspace are now deployed to the same Managed Server called
Foundation Services Web application (and share port 28080).

For Reporting and Analysis:

The Financial Reporting Server and the Financial Reporting RMI Registry are now part
of the Financial Reporting Web application.

The Financial Reporting Scheduler has been merged into the Financial Reporting Web
application.

A new Web application called the Reporting and Analysis Framework Web application
has been introduced. This Web application includes the Reporting and Analysis plug-
in to EPM Workspace. This Web application uses port 45000.

The Configuration and Monitoring Console (CMC) has been merged into the Reporting
and Analysis Framework Web application. The CMC Agent is now called Reporting and
Analysis Framework Agent.

EPM Workspace Services are now renamed to Reporting and Analysis Framework
Services.

The EPM Workspace Web application port has been changed from 45000 to 28080.

For Essbase:
Essbase Server can now be managed using OPMN to start and stop services.

Essbase now supports active-passive failover without Oracle Clusterware. You can use

EPM System Configurator to configure Essbase in an active-passive failover
configuration with write-back capability.

Two new products have been introduced: Financial Close Management and Disclosure
Management.

For Financial Management, a new Web application called Financial Management Web
Services Web application has been added to support Financial Close Management.

For Shared Services:

OpenLDAP has been removed as Native Directory, and the architecture has been
simplified to use a relational schema in a relational database.

The Jakarta Slide component has been removed.

Shared Services now supports an active-active cluster configuration.

Shared Services no longer releases Hyperion Remote Access Module (HRAM).

I have been seeing this issue off late during the starup of weblogic server in few Siebel instance, when you start up weblogic server it will fail with the below error message, cause be you killing the poor weblogic process. Reason for kill is being “We stopped Managed Server and it errors out so went for kill -9″. If Managed Weblogic fails to stop, debug it further instead of going for the kill.

Error Log:
=======
<Mar 2, 2010 7:35:23 AM CST> <Notice> <WebLogicServer> <BEA-000365> <Server state changed to STARTING>
<Mar 2, 2010 7:35:23 AM CST> <Info> <WorkManager> <BEA-002900> <Initializing self-tuning thread pool>
<Mar 2, 2010 7:35:23 AM CST> <Notice> <Log Management> <BEA-170019> <The server log file /dasc13/oraclebi/bea/product/wl_103/user_projects/domains/DASC13/servers/
AdminServer/logs/AdminServer.log is opened. All server side log events will be written to this file.>
<Mar 2, 2010 7:35:29 AM CST> <Notice> <Security> <BEA-090082> <Security initializing using security realm myrealm.>
<Mar 2, 2010 7:35:29 AM CST> <Notice> <Security> <BEA-090083> <Storing boot identity in the file: /dasc13/oraclebi/bea/product/wl_103/user_projects/domains/DASC13/servers/
AdminServer/security/boot.properties>
<Mar 2, 2010 7:35:30 AM CST> <Error> <Store> <BEA-280061> <The persistent store “_WLS_AdminServer”
could not be deployed: weblogic.store.PersistentStoreException: java.io.IOException: [Store:280021]There was an
error while opening the file store file “_WLS_ADMINSERVER000000.DAT”
weblogic.store.PersistentStoreException: java.io.IOException: [Store:280021]There was an error while opening the
file store file “_WLS_ADMINSERVER000000.DAT”
at weblogic.store.io.file.Heap.open(Heap.java:167)
at weblogic.store.io.file.FileStoreIO.open(FileStoreIO.java:88)
at weblogic.store.internal.PersistentStoreImpl.recoverStoreConnections(PersistentStoreImpl.java:332)
at weblogic.store.internal.PersistentStoreImpl.open(PersistentStoreImpl.java:323)

If you kill wls few things we need to take care of before starting it back.

1. It will setup .lok files for Admin Server, Managed Servers, and ldap (EmbeddedLDAP.lok)
2. It will also have few persistence store files and it will get corrupt.

Solution:
======
Move _WLS*.DAT (generated under diagnostics folder) and *.lok files (generated under tmp folder under Admin Server)
and restart the server back again and it will recreate those files again.

-bash-3.2$ find . -name “WLS_DIA*”
-bash-3.2$ find . -name “*.lok”

[INFO] AuthChallengeProcessor - basic authentication scheme selected
[INFO] HttpMethodDirector - Failure authenticating with BASIC ‘WebLogic Server’@
auhodclsnp5.oracleoutsourcing.com:20501
Exception in : Login
com.hyperion.interop.lib.AuthenticationException: Authenticated has failed using
the supplied credentials
com.hyperion.interop.lib.AuthenticationException: Authenticated has failed using
the supplied credentials
at com.hyperion.interop.lib.Repository.connect(Unknown Source)
at com.hyperion.interop.lib.Repository.<init>(Unknown Source)
at com.hyperion.interop.lib.Repository.connect(Unknown Source)
at com.hyperion.interop.lib.Repository.connect(Unknown Source)
at com.hyperion.interop.lib.Repository.connect(Unknown Source)
at com.hyperion.planning.HspHub.login(Unknown Source)
at com.hyperion.planning.appdeploy.HspManageAppSession.getProjects(Unkno
wn Source)
at jsp_servlet.__appwizard._jspService(__appwizard.java:1582)
at weblogic.servlet.jsp.JspBase.service(JspBase.java:34)

Fix
—–
Place <enforce-valid-basic-auth-credentials>false</enforce-valid-basic-auth-credenti als> before closing the </security-configuration> section in %HYPERION_HOME%\deployments\WebLogic9\config\config.xml

Then bounce WLS, if it does not work still bounce Planning and Workspace also.

MDM is one super product, and after install and config you might get crazy seeing that Windows MDM services will not start..  It will say services started and it will go down in couple of seconds.

Exception EOleException with message ‘ORA-12154: TNS:could not resolve the connect identifier specified

Unable to logon to database “TCLS17″ as user “mdm_db”: DALConfig = <database-connection label=”MDM_NTier” type=”oracle” schema=”MDM” service-name=”TCLS17″>
<db-login user-name=”mdm_db” password=”aTa5aeQA9VlBM+SOQj4tlQ==”/>
<engine-login user-name=”mdm_system” password=”aTa5aeQA9VlBM+SOQj4tlQ==”/>
</database-connection>’.

Fix
—-

Launch the DRM configuration console, in that navigate to Database settings key in again the Engine login password and Database Login password as Welcome1 which is the default password for DRM. Save the changes and start the services back again. It will start

While running ERP Integrator Configuration it failed with the below error. Later on we found that HSS login page was not coming up.

2009-11-11 04:14:11,464 INFO  [Runnable bean context: Run All Tasks Wizard Action (runAllTasksWizardAction)] CSS is initialized as  client. The default logger properties will be loaded com.hyperion.css.CSSSystem.<init>(Unknown Source)
2009-11-11 04:14:11,464 INFO  [Runnable bean context: Run All Tasks Wizard Action (runAllTasksWizardAction)] CSS Log file will be generated at D:\pmfgh7\Hyperion/logs/config/\SharedServices_Security_Client.log com.hyperion.css.CSSSystem.<init>(Unknown Source)
2009-11-11 04:14:11,464 INFO  [Runnable bean context: Run All Tasks Wizard Action (runAllTasksWizardAction)] Configure CSS with registry com.hyperion.css.CSSSystem.initCSSSystem(Unknown Source)
2009-11-11 04:14:11,464 INFO  [Runnable bean context: Run All Tasks Wizard Action (runAllTasksWizardAction)] Initializing CSS from Registry. com.hyperion.css.common.configuration.CSSConfigurationManager.getConfiguration(Unknown Source)
2009-11-11 04:14:11,480 INFO  [Runnable bean context: Run All Tasks Wizard Action (runAllTasksWizardAction)] Trying to get Registry Instance com.hyperion.css.registry.RegistryManager.<init>(Unknown Source)
2009-11-11 04:14:11,558 INFO  [Runnable bean context: Run All Tasks Wizard Action (runAllTasksWizardAction)] Got Registry Instance com.hyperion.css.registry.RegistryManager.<init>(Unknown Source)
2009-11-11 04:14:11,792 INFO  [Runnable bean context: Run All Tasks Wizard Action (runAllTasksWizardAction)] Got hub location from Registry:http://auhodmfghp5.oracleoutsourcing.com:20001 com.hyperion.css.registry.RegistryManager.getHubLocationFromRegistry(Unknown Source)
2009-11-11 04:14:11,902 INFO  [Runnable bean context: Run All Tasks Wizard Action (runAllTasksWizardAction)] Got native directory location from Registry:auhodmfghp5.oracleoutsourcing.com:10089 com.hyperion.css.registry.RegistryManager.getNativeProviderLocationFromRegistry(Unknown Source)
2009-11-11 04:14:11,902 INFO  [Runnable bean context: Run All Tasks Wizard Action (runAllTasksWizardAction)] URL constructed out of values in Registry database:ldap://auhodmfghp5.oracleoutsourcing.com:10089/dc=css,dc=hyperion,dc=com com.hyperion.css.common.configuration.CSSConfigurationImplXML.initConfiguration(Unknown Source)

Fix
—–
Default installation of WLS will allow access for 5 unique IP Address only, once we update the license file config issue was resolved.

During hfm configuration we will see failures on the belowlist

Configure Application Cluster
Register Application Servers / Cluster

If we run through the error log we will see this

(Thu Nov 05 02:15:35 2009) Successfully set the user to DCOM limits
(Thu Nov 05 02:16:03 2009) Failed to set cluster definition to the database Line:1120 File: .\CHFMConfig.cpp Error code:0×80004005 Error: Unspecified error
(Thu Nov 05 02:15:35 2009) Successfully set the user to DCOM limits
(Thu Nov 05 02:15:35 2009) Attempting to configure the cluster/server
(Thu Nov 05 02:16:03 2009) Failed to set Application Servers and Clusters. Line:515 File: .\CHFMConfigUtil.cpp Error code:0×80040811 Error: IDispatch error #1553
(Thu Nov 05 02:16:03 2009) General Error. Line:827 File: .\CHFMConfigUtil.cpp Error code:0×80040815 Error: IDispatch error #1557

Fix
—-
Navigate to %hyperion_home%\products\FinancialManagement and open the file oracle_hfm.udl, it will have an entry with a , in the DATA SOURCE. Remove it and rerun the config it will complete fine.

When we run Server Web Configuration of HFM at times we may hit “Unknown Error” and we will check the config error log it will not update anything. So we had a quick look at the Event Viewer under Applications we had this error log, which I did not have any understanding of it.

Error 11; hydhydr7; 11/03/2009 22:32:04; CHFMCASSecurity.cpp; Line 53; <?xml version=”1.0″?>
<EStr><Ref>{BCF41112-7D2D-4D2A-9A26-7840D8324386}</Ref><User/><DBUpdate>1</DBUpdate><ESec>
<Num>-2147467238</Num><Type>1</Type><DTime>11/3/2009 10:32:04 PM</DTime><Svr>RMHODTESTP12</Svr><File>
CHFMCASSecurity.cpp</File><Line>53</Line><Ver>9.3.1.0.1502</Ver></ESec></EStr>

Fix - We use one local user account (!fdminstall) for hfm configuration, once we reset password  of the local user issue was fixed.

At times after fresh install of BI+, you might hit this error in the java console and you will get a blank applet when you launch WebAnalysis. So to fix this restart BI+ services under services.msc and restart the oc4j components in sequence.

Stop FR, WS and WA oc4js
Start FR, WS and WA

Caused by: java.lang.IllegalStateException: Cannot create
unregistered service: analyzer.licensing.service
at com.hyperion.atf.services.
ServiceManager.getService(ServiceManager.java:267)
at com.hyperion.atf.services.ServiceManager
.getService(ServiceManager.java:300)
at com.hyperion.atf.services.distributed.
DistributedRequestProcessorServer.process
(DistributedRequestProcessorServer.java:146)
at com.hyperion.atf.services.distributed.http.
RequestProcessorServlet.process(RequestProcessorServlet.java:152)
at com.hyperion.atf.services.distributed.http.
RequestProcessorServlet.doPost(RequestProcessorServlet.java:118)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:763)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:856)
at com.evermind.server.http.ResourceFilterChain.doFilter
(ResourceFilterChain.java:64)
at com.hyperion.i18n.filter.Utf8Filter.doFilter(Unknown Source)
at com.evermind.server.http.ServletRequestDispatcher.invoke
(ServletRequestDispatcher.java:621)
at com.evermind.server.http.ServletRequestDispatcher.forwardInternal
(ServletRequestDispatcher.java:368)
at com.evermind.server.http.HttpRequestHandler.doProcessRequest
(HttpRequestHandler.java:866)
at com.evermind.server.http.HttpRequestHandler.processRequest
(HttpRequestHandler.java:448)
at com.evermind.server.http.AJPRequestHandler.run
(AJPRequestHandler.java:302)
at com.evermind.server.http.AJPRequestHandler.run
(AJPRequestHandler.java:190)
at oracle.oc4j.network.ServerSocketReadHandler$SafeRunnable.run
(ServerSocketReadHandler.java:260)
at com.evermind.util.ReleasableResourcePooledExecutor$MyWorker.run
(ReleasableResourcePooledExecutor.java:303)
at java.lang.Thread.run(Thread.java:595)

Was unable to start EPMA windows services, below was the issue and the fix

Issue got fixed after changing the port from 5250 to 5255 in the BPMA_SERVER_CONFIG.xml file in the %hyperion_home%\BPMA\AppServer\DimensionServer\ServerEngine\bin. Port 5250 was occupied by some other process, so changed it and services startup fine.

Once we login HFM and click on open application it will error out for authentication issues. To solve this we need to add the below line in %hyperion_home%\deployments\WebLogic9\config\config.xml file

   <node-manager-username>hyperionnode-manager-username>
<node-manager-password-encrypted>{3DES}weLFQ0l+HvCXqB36mIQZDQ==node-manager-password-encrypted>
  <enforce-valid-basic-auth-credentials>false</enforce-valid-basic-auth-credentials>

 Recycle the weblogic and hfm services.