OOW – Day 4 – The final session – Oracle Enterprise Manager – Custom Application Management

In this session we will have more insight in the different features available in Oracle Enterprise Manager to deploy custom applications.

Key message:

  • Use out-of-the-box models to represent your services
  • Monitor your applications from end-user perspective (pro-active and passive)
  • Monitor your application specific metrics => expose via JMX and Web Services
  • Build reports

What is a custom application?

  • J2EE Applications
  • Applications exposing metadata via JMX or Web Services
  • Oracle Forms Applications
  • Web-based applications (.net, php)

1a. EM Feature: Pro-active monitoring :

In pro-active monitoring you’re tracking the known transactions for your application.

  • Web transactions: intuitive recorder => playback transactions from Beacon (EM agent)
  • Forms transactions: intuitive recorder for Forms 10.1.2, 9.0.4 and 6i applications
  • Generic service tests: to test any protocol-based services

1b. EM Feature: End-user monitoring:

In end-user monitoring you don’t know which transactions will get launched, so you need to listen for them.

Passive end-user monitoring:

  • Watch URL Response times => by domain, region, visitor, web server
  • Forms 10.1.2 => commit, query, runform, callform, newform

2. Service-level dashboard: monitoring of SLA’s

3. Application Diagnostics for Java (AD4J):

An agent running on the application server to diagnose Java Applications.

  • No performance overhead and instrumentation complexity of BCI based tools
  • Transaction tracing capability => java transactions through db sessions and vice versa
  • Oracle, non-Oracle, Java Servers & Standalone Java Applications

4. Infrastructure diagnostics:

  • Historical views and trends
  • Monitoring templates
  • Alerts, notifications

5. Management Plug-in:

Extend Enterprise Manager functionelity for custom components using Management Plug-in.

How to create a management plug-in:

  1. Define metrics to collect and tresholds
  2. Develop metadata file (in XML file) to declare metrics, associate scripts
  3. Validate using ILINT
  4. Package in management plug-in archive (MPA)

How to create management plug-in for Web Services, JMX:

  1. Run CLI (Command Line Utility) JMX or Webservice
  2. Package Management Plug-in Archive

6. Custom Application Monitoring:

  • Out-of-the-box homepage for all custom applications
  • No need to write UI code
  • Provides consolidated view of availability and alerts
  • Reporting available using PL/SQL API

For more information there’s an Oracle By Example available on OTN.

OOW – Day 4 – Leveraging SOA to maximize your applications

This session was handling the effect of SOA in an organisation and the challenges each organisation faces today and how you can address these using SOA.

The main keynote that was mentioned here: There’s no way to avoid SOA because SOA Components will be backed inside each software package a company purchases.

So what are the challenges each company is facing today?

  • Reliable batch interfaces
  • Lack of reliabilit
  • Customization of code, rebuilding of code
  • No standardization

How are these challenges addressed using SOA?

  • Modular approach
  • Reusable components which are developed in a granular approach
  • Standards-based (XML, XSD, JCA, WSDL, …), nothing proprietary is being used
  • Focuses on orchestration of services instead of monolithic applications
  • Reduce overall testing effort when re-using services

Why choose SOA?

  • Need for multiple user-friendly applications
  • Complex workflow not delivered in ERP
  • Reuse of services for same business functionality
  • Centralize business rules
  • Give more insight into business

Considerations:

  • Buy-in, you need to discuss the initial investment with the different stakeholders and discuss the ROI
  • Retrain your staff and invest in training, coaching
  • Explain how roles will change in as well functional as technical departments
  • Initially development will be slower because of the steep learning curve

When discussing and talking about SOA, you will always be addressing these kind of problems and issues in any organization. SOA is just a way of thinking and doesn’t mean you need to purchase different kinds of products to make the integration happen.

What the Oracle SOA-product stack will give you is ease of development; declarative environment to work faster, more efficient; common problems are being addressed using design patterns; rich user interfaces can be developed using drag-and-drop functionality; composite designers will enable you to integrate your existing business processes with any legacy system your company has purchased in the past … in other words …

To give a company an insight in it’s SOA awareness and to give them free advise on how to get started, Oracle offers the ‘Roadmap to SOA’. Through different roundtables the customer will get insight in it’s SOA readiness and how they can start with a modular approach.

What are you waiting for … Let’s start integrating !

Some guidance, coaching, product overviews and of course demo’s that show and prove to you that ease of integration … let’s start blogging ;o)

No Slide Zone – Tom Kyte

Today was the first time to attend a session in the ‘No Slide Zone’ which is one of the special programs presented at Oracle Open World. During these sessions no slides can be used, in other words this is no typical conference track.

The keywords for a ‘No Slide Zone’-session: ‘discussion, interaction, whiteboarding and more’.

The session I had chosen, ‘Tom Kyte presents 10 new features for Oracle Database 11g’ … and it was fun ;o)

Using different paper notes he mentioned and discussed the 11 different features which are now made available in 11g and explained which problems they solved.

Every time he mentioned a feature and explained the usage and gain of it, he threw away the card which was a really fun way of presenting.

After he had mentioned the 11 new features, the people could ask some questions … and to make sure questions were asked … books regarding 11g were given to the first 12 people asking a question. Everyone in the room had a question … this is a reminder for myself for future presentations and sessions.

So let’s stop talking and give you those features wright ;o):

  • Virtual Columns: ability to use functions instead of creating a new column for calculations => the outcome is beter cardinality which means a beter execution plan
  • Compress Data & MetaData
  • Finer Grained Dependencies => if the signature of a procedure doesn’t change (the input/output parameters), the procedure won’t be invalidated. When columns are added or dropped from tables, no invalidation occurs, if specs are added to packages, no invalidation occurs
  • Compress data for transactional data not only for read-only data => compressioning will work for conventional paths as well (CRUD-methods) which will save space and audit retrieval will be faster
  • Flash Data Archive: enew background process is used, flashback-process which will use the flashback query for data retrieval
  • Partioning is extended and now enables: partionining by virtual columpns; reference-partioning which will give the ability to partition on master-data from a child-table. The child-table doesn’t need to be denormalized anymore, so the attribute of the master-table is available in the detail-table. The last partioning-feature added is interval-partioning which will give you the ability to performed sparsed partioning
  • Encrypted tablespace => store data on block, in the index in clear data and afterwards when the data is written in clear text, the tablespace block will be encrypted
  • Cache more stuff => statement results can be cached; server-result cache which means just-in-time materialized views are used (use the buffer cache or shared pool); pl/Sql function cache which will mark the function as result cache
  • Stand-by database => for logical standby’s datatype support has been extended and for physical standby’s, active standy is now fully supported
  • Real Application Testing => catch the workload of your db 10g release 1 db and run the same workload on your db release 2 database using Real Application Testing

It was an amazing session and these are amazing features which will improve the DB’s performance and maybe, somewhere in the very, very far future DBA’s aren’t needed anymore ;o)

OOW – Day 3 – Keynote Thomas Kurian

Today I had busy schedule as well … so let’s start talking wright ;o)

The first session I attended was the keynote-speech of Thomas Kurian:
The acquisition of Coherence has been a huge step forward in datagrid enabling the Oracle Fusion Middleware stack.

Coherence could be defined as ‘in parallell processing of transactions which live in-memory and are spread over differnet datagrid engines.

Which benefits can we gain from it:
- 30% more benefit
- less power needed
- less feeds needed
- half as many servers needed

and more over, Coherence still offers absolute reliability and consistent availability.

- Application Server is JEE 5 Compatible which supports WS-* (quality of service), JAX-* and EJB 3.0

What about the OFM offering:
- IDE that integrates all the different technologies of SOA together, such as esb and bpel design, web application design using ADF or Webcenter. By using customizable skins Oracle offers the possibility to use the same application as a JSF application or rich client interface using AJAX, DHTML.

In 11g we will be able to design SOA Composites inside JDeveloper which will hold the entire SOA-technology stack, such as BAM, BPEL, ESB and will give the user the ability to drill down into the specific service he/she’s interested in.

Bpel has been extended :
- System-oriented processes: such as the prepackaged processes for integrating with Siebel, SAP, ERP-systems, …
- Human processes
- Document-centric processes (excel sheets, word documents, …) will all be transformed to service-enabled messaging formats such as pdf, xml, …

Complex Event Processing (CEP) & Activity Monitoring has been added as well to add the ability to collect events in memory and perform analytics on these events use CQL, the Complex Event Processing query language.

Enterprise Manager is now a fully featured management applications that will hold all needed functionality to control services and OWSM has been integrated as well. You will have one single point of thruth to manage your entire SOA enabled application.

Throughout a ‘Best Bank’-demo Thomas has shown us the different customer needs and business value throughout the Oracle offering.

The technology-stack that was used throughout the demo:
- JDeveloper
- SCA Composite Editor which is an add-on in JDeveloper 11g
- ADF Developer and ADF Task Forms
- BAM Datacontrols
- Shared repository to give the user the ability to change the web application on any given time he wants.
- All office applications are now supported as well (Excel spreadsheet is build into web application)

The Web 2.0 or Enterprise 2.0 Experience:
- Universal Content Management
- Conversion and filtering of content using tags and categories
- Render files to web-enable the application (word, Excel, … to PDF, XML)
- Open Web Content Management system giving the end-user and developers the possibility to use any UI technology they want such as PHP, JSP, JSF, Ruby on Rails, …
- Archiving and Record Management
- Webcenter (dashboard to integrate adf, portal, discussion forums, forms, third-legacy applications, …)
- Webcenter spaces to share information and create an online community
- Composer: give the user the ability to adjust the application at run-time by dragging and dropping compoentns from the Composer.

OOW : Forms 11g – Forms to SOA – Oracle Data Integrator – OFM High Availability

Yesterday a couple of more sessions were on the agenda, which were all very interesting and of course a lot of sneak previews ;o)

Oracle Forms: Strategy and road to SOA
The first session was given by Eurotransplant, a company from the Netherlands that has implemented SOA in its forms-environment in the past few years. During this session Oracle has given an insight on Forms 11g, the road ahead and Eurotransplant gave an insight on the lifecycle they went through.

The most important keynote to keep in mind for Forms 11g is the ability to hook in bpel, human task workflows inside your forms application. The forms application will be event-driven in the future, so the end-users can react upon events through using JMS and Advanced Queueing.

The way Eurotranplant has integrated SOA into their environment was by first giving its Forms-developers a J2EE-development course using the JDeveloper environment and ADF Faces (first they used plain JSP and afterwards UIX), but Faces is the future. By using JHeadstart they could use the automatic generation framework on their existing Forms application.

In 2006 they’ve implemented the first BPEL process and hooked it up inside their forms application. A more advanced bpel process is being implemented right now and will be completed next year. To be able to hook-up bpel processes and service-enable their forms application, they’ve put the business logic which was inside their forms application inside the database. These pl/sql procedures, packages can then e called through pl/sql webservices and integrated inside new bpel processes and their forms applications.

The second session was given by Dave Berry and David Shaffer regarding the new SOA Grid enabled application.
Next generation Grid enabled SOA:

Features:

  • DataGrid Servers: Asynchronous write-behind queues to dehydrate data
  • Grid maintains one instance data of business logic, which can be a service such as bpel process
  • Build new messaging layer that takes advantage of grid-enabled to subscribe to state-changes
  • In memory access feeds (no disk-assistance required)
  • Activate/Rehydrate, relocatable bpel processes
  • Say no to HUB-and-SPOKE
  • Dehydrate current bpel process into grid, and relocate in another grid

SOA GRID:

  • Better performance and availability of bpel processes via SOA GRID
  • Release: 11g , next year
  • ESB Mediation:
  • Primarely stateless against bpel which is primarly statefull
  • Execute async-rule sending rid payload reference id through JMS
  • Subscribe to payloads via reference calls

New Model for Scaling SOA:

  • A new model for efficient resource utilization => scale up horizontally
  • Work together with Coherence for data-usage use cases
  • Use soa-grid inherently for as well cpu, memoiry
  • State-aware continuos availability for service infrastructure
  • Software-only solution, no hardware costs necessary
  • Heterogenous environment

The 3d session that I’ve scheduled today was regarding Oracle Data Integrator, which I’ve blogged about regarding setting up a migration path.

Event-Driven Business Intelligence from Heteregoneous Data using ODI:

The most important message given in this session was: ODI will be integrated in all technology stacks of Oracle, such as BI EE, Oracle SOA Suite

Enterprise Information Management:

Challenges:

  • Understand the past (BI)
  • Coordinate the present (BPM, BAM)
  • Plan for the future

ODI Strategy:

  • Pre-integrated with Oracle Middleware & Applications, BI Tools, Hyperion, Packaged Applications (ERP, CRM), Master Data Management, Fusion Application Pilars

ODI Offering:

  • ODI Core
  • Oracle Data Quality for DI (ODQ)
  • Oracle Data Relationship Management

Differentiator:

  • Declarative design
  • Knowledge modules
  • Active datamodel (change data capture)
  • Batch loads are performed faster via data-caching on staging area
  • Adapters are for free in the whole ODI stack
  • Oracle Data Quality Profiling => changes it into data quality rules

And the last interesting keynote : A Game has been organized during Oracle Open World, to win a plasma screen, car, etc. and this game is using RFID-tags, BAM and ODI as its technology stack. Sadly enough only US citizens can win these prices :(, maybe I’ll need to immigrate to the US before I come to Open World ;o)

The last session for today was very interesting and gave more insight on the different integration efforts oracle is providing throughout its technology stack.

High Availability for Oracle Fusion Middleware:

New Features in OFM 11g:

  • On Demand Scalability
  • Non-stop availability
  • Unified Management: Using the Middleware Administration Server (MAS) and the MAS Repository for configuring changes in one single point of truth, the MAS. The MAS Agent will then push the changes made in the Server to the different OC4J instances existing in your farm.
  • Resource Discovery via MAS: runtime announcement of services, no downtime needed which virtualizes the OC4J connection information
  • OFM Load Balancer: create virtual IP’s
  • Cold Failover Cluster with Oracle Clusterware (CRS), Cluster Manager & Cluster Server
  • High Availability Patching through which you can patch in a sequential manner when you have different Oracle homes or perform out of place patching when you have shared Oracle Homes. Using the Out Of Place Patching you will clone the shared Oracle Home, perform the patches, and merge the cloned Oracle Home with the non-patched version

The most interesting feature and ‘stockhorse’ (stokpaardje) of Oracle: Oracle Coherence which can be described as ‘RAC for the Middletier’.

What are the different features?

  • Distributed Management Solution
  • Runs inside JVMs
  • Automatic ‘scale out’/ horizontal scaling
  • Automatic High Availability : every object in memory has a backup via another server
  • Extreme transaction processing
  • Runs business logic inside the Grid: Analytics
  • Trigger other consumers, applications when data changes in the grid using a push or pull-mechanism

That was it for today, I’ll keep you posted …

Oracle Open World – Keynote Charles Phillips

This morning a Keynote was given by Charles Phillips, President of Oracle Corporation. In this keynote Charles Phillips gave us an insight on the vision of Oracle and the strategy in marketting this vision throughout it’s customers, partners and of course software offering.

Each Challenge was tackled by the different Oracle Offerings there are today.

CEO Challenge:
The CEO of a company needs to integrate different kinds of applications and once in the boardroom he needs to be able to point all noses in the same direction, the direction of ROI.

This Integration-challenge can be tackled by the new Application Integration Architecture offering of Oracle. Through a demo we saw how this challenge was tackled using Webcenter dashboard as a centralized view-point, JDeveloper as the integrated Development Environment and BPA which was used for the full round-tripping of business analysis and development.

Using this Oracle Technology offering, the AIA, the CEO can integrate his existing Siebel, SAP, Financials or CRM applications in a unified, uniform and more-over standardized way.

CFO Challenge:
The Chief Financial Officer has other concerns such as governance and risk management to keep in mind throughout the different processes in his/her company. How can Oracle offer a solution to this common problem, faced within every company that has a diversity of policies and rules to adhere to.

The Oracle Governance & Risk Competence Manager:
Through this manager the CFO has a one-stop view to control the different policies which are defined throughout the organisation. If a certain rule is being violated, the Manager will show up a red light and in 1 step the CFO can change/adapt the policy rules so the company’s back on track.
This manager uses a centralized content repository and enforces the policies at runtime using the Active Apps Policies Suite.


Another Security-stack being offerd by Oracle entails the Database Vault and Audit Vault to secure as well data as audit data in an Integrated Security Stack.


Engineering & Manufacturing Manager:
The engineering and manufacturing manager has a lot of challenges as well, such as keeping insight on the product stock and having the ability bto manage the entire product lifecycle without any delay.

Oracle offers ‘Oracle Agile PLM’ to tackle all of these requirements, the Oracle Product Lifecycle Management Technology Stack.


In the demo we saw that the manager had a centralized view on all the needed data using Webcenter dashboard and a Shared Content System.
The webcenter dashboard could be hooked up with third-party legacy applications through adapters and uses XML standards based messaging for this purpose.

Operations Challenge, Gaining Actionable Insight:
The operations challenge every administrator, manager is facing today: act when necessary!
If a glitch has occured during a business process lifecycle, a product is out of stock, an order hasn’t been processed correctly, if a given manager hasn’t updated his tasks-lists, in other words when a bottleneck is being introduced inside the company … we need to be able to act!



Through the usage of Enterprise Performance Management Workspace, BI Enterprise Edition and the Action Framework we can act upon these glitches immediatly.

Through the Enterprise Performance Management Workspace, we have a real-time view on the business processes in our company, and act when necessary.

The Action Framework gives us the possibility to interate transactions, historical data and tasks so were able to act correctly given we have all the needed data to provide with an accurate view on our current business.

Through the usage of Packaged BI Applications (Financial Package, Operations Package, CRM Package), the customer can purchase thed package which is measured for his/her company.

How can we manage these heterogenous environments?
Enterprise Manager Services Dashboard gives us the capability of monitoring and administrating the different services which are running inside our business.
The EMSD gives a follow-up on as well the business as the system metrics in our organisation.

Through this EMSD we can enable Real Application Clustering at runtime, without downtime.

Oracle Open World – New Integration Solution Offering

Sunday morning I went to a session regarding Application Integration Architecture, the new Oracle integration-solution offering.

The session was given by Selim Burduroglu of the IOUG Group.

During this session Selim was going to explain the SOA and Integration strategy of Oracle.
The goal : Nothing proprietary in AIA or SOA Suite, every technology, layer, approach is standards-based.

As you would have noticed already in the different presentations given by Oracle regarding Oracle Soa Suite or Oracle Application Server => the main goal is: pick your flavor ;o) You can choose any Application Server you want, any database you want …

The Application Integration Architecture proposal holds 5 different tiers, from top-to-bottom:
- Integrated UI Tier (J2EE (webcenter, adf), apex, Forms)
- Process Tier
(Process Integration Packs-offering)
- Virtual Service Tier (Services
Repository)
- Data Management Tier (Oracle Data Integrator)
- Application Tier (Oracle Apps, legacy or third party applications)

Now what is a PIP, a Process Integration Pack exactly: the PIP holds all the needed logic, adapters, processes, business objectsd, business services for a given business requirement. To give you an example: you want to integratie Siebel with your existing services, which can be a bpel process, a webservice, well this is all packaged in a given PIP.

What are the Common Objects & Services being delivered with AIA:
- Enterprise Business Object: an object that describes your common data model throughout the business in a unified way (an xsd)
- Enterprise Business Service (EBS): A service that interacts with your business object, transforms and routes to other EBSes where necessary
- Services Repository / Enterprise Service Repository: A catalog of all the different business processes/services which are inside your company’s portfolio.

The Enterprise Business Object (EBO) can be described in any given format used by your businerss analyst or architects, such as UML Class Diagrams, …

In the AIA the Application Business Connector Services will map the Enterprise Business Object to an Application Object used by partners, third-party applications which will transparently transform the data to your needs.

In this AIA Oracle also offers the needed tools and methodology to guide you through the entire development lifecycle.

Tools:
- Business Services Repository for SOA Governance
- Composite Application Validation Systems to provide the needed unit- and regression testing throughout your application integration lifecycle
- Common Error Handling & Diagnostics

No Unified versioning mechanism is made available yet in this release, but my comment has been noted ;o)

Methodology:
- AIA Developers Guide which gives you a blue print on the process definition, integration standards, design patterns and extensions you can define.

Oracle Open World – Amazing …

Well I have to admit, you really have to experience this once, to know what big of an event this really is.

Through the Oracle Fusion Regional Director program I was invited to Oracle Open World to get in touch with the other ace’s and ace directors and of course with the product team.

We needed to share our experience and knowledge with the product team and of course mind-mapping with the other regional directors.

Yesterday we had an ace-meeting in which we’ve talked about the different 11g releases and the road ahead. After the ace-meeting it was time to go to Larry Ellison’s keynote speech.

This was amazing, and I need to show you all the footage I have on this when I’m back home. He talked about the beginning of Oracle, how they started out, what their main lifestyle and focus was and how they got to be as big and succesfull as they are today. Different pictures and videos were given from the different managers and CFO’s in their younger days and of course different mash-ups they’ve directed concerning Oracle’s approach.

One play was awsome regarding ‘what happens when Oracle takes over your company’, this was really,trully great ;o))

After that we had an ace-dinner which was really great to get acquanted with everyone and to have a feeling of everyone’s experience/knowledge … and most of all to have a great time out.

Because of the jetlag-feeling I went home afterwards, no after dark parties for me anymore.