|
Softpanorama |
May the source be with you, but remember the KISS principle ;-)
|
Tivoli Enterprise Console (TEC) was an old flagship of the Tivoli product line because it is the focal point of collecting events from several other Tivoli products. Functionality is OK but the quality of the interface is low. Now with Omnibus considerably overlapping functionality (and Micromuse acquisition) question what will happen to it is not very clear. Not very user friendly as it uses pretty obscure language (Prolog), but at least it is programmable. Semantic is complex and can be learned only gradually.
Some things still look strange event after several years of experience (rules for closing rules via messages is one such example -- it looks like it closes the last opened message of the same type not the first one). Complex tasks generally requires either consultants or bright people among staff. Sometimes simple task require the same :-).
TEC was really an innovative solution at the time it was released and still it contains several interesting implementation ideas. Among them:
Internal architecture is also interesting and was pretty innovative in 1994-1996 when it was designed (at this time servers have on average less then a gig of memory, CPU speed was around 0.1GHz and 1G drive was a pretty large and expensive drive. ) It many ways TEC defined the field of large enterprise event processing.
Now many architectural decision look old, the structure of the events with fixed length field looks somewhat ugly and with scripting languages and HTTP protocol CORBA became completely meaningless in this particular domain...
The event server architecture consists of five processes:
| Process Name | Description | Log File | |
|---|---|---|---|
| tec_server | The master process | /tmp/tec_master | |
| tec_reception | The reception engine process | /tmp/tec_reception | |
| tec_rule | The rule engine process | /tmp/tec_rule | |
| tec_dispatch | The dispatch engine process | /tmp/tec_dispatch | |
| tec_task | The task engine process | /tmp/tec_task |
An additional process, the UI server process, plays an integral part in the overall Tivoli Enterprise Console architecture. The UI server is not a part of the event server, although it communicates with the event server. Each process has its own log file.
The most prominent feature of TEC is the usage of Prolog interpreter for writing rules and perfoming correlation. While it was probably fashion-based solution (Prolog was all-scream, top fashion thing in 80th) in retrospect the decision to use Prolog interpreter as the correlation engine looks like a mixed blessing.
On the plus side we need to admit that:
On the minus side non-procedural programming does not give it much advantages and Prolog does not have the power of modern scripting languages. To be fair we need to admit that Prolog was extended by IBM in a rather clumsy way to allow some level of procedural programming. But still this is programmable (which is better then open) solution as Prolog is a established standardized programming language. It also makes TEC a very rare example of a widely deployed expert system (although most Tivoli users does not utilize advanced capabilities of the Prolog engine). Prolog can be a good query language but only for top-level specialists.
If used by highly skilled Prolog programmer such an engine is a powerful tool. But most Tivoli administrators are not Prolog programmers and have difficulties using the rules engine. It is also rather difficult to use correctly as the number of documents and number of pages in each document are large but useful information is very scarce (IBM docs contain 66% or more of fluff).
An important caveat here is the phrase "to use correctly". TEC is an expensive platform that requires (as many complex systems do) expert developers and system architects to build true world-class solutions. Those costs are non-productive costs which IT department needs to bear. Moreover without a proper understanding of the underlying architecture of TEC and Prolog, it is possible to develop only a primitive event tracking applications which might be done quickly with much less effort and expense by using any open source monitoring package like mon, Zabbix, Nagios, etc. that's why the return on investment in a typical TEC shop is low to marginal -- the complexity eats all the benefits. for simpler envirments But with experts the TEC platform brings can be a competitive advantage to the company as you can do things that other companies cannot...
The first rule of TEC deployment is to offload Prolog engine from the most basic processing, like duplicates removal. A cleaner architectural solution is to use two level event filtering with the gateway-based filtering (non-Prolog based) performing routing filtering tasks and aggregating events and Prolog processing on Tivoli server level devoted only to really important and reasonably rare "derivative' events (two level solution might also necessary from the availability point of view as Prolog engine is incapable to withstand even a mild "event storm" ).
The second rule of TEC deployment is to structure TEC rule base in such way that each rules set process only specific type of messages or several closely related types. That permits to implement a "master select statement" in event processing and use pretty complex rule-bases without fear that the engine becomes too overloaded.
TEC uses BAROC as the events structure definition language and as such the description has the flexibility limited to C structures programming. In other words the structure of the message is fixed and types of the fields are fixed too. This proved to be less limitation that one might think.
Minimum configuration TEC is just $3K and using Linux-based deployment and logadapters you can monitor any number of servers you wish without breaching the license. Essentially using endpoints on log-aggregation servers and converting events from some open source monitoring solution into TEC event via some kind of bridge permits using TEC correlation engine at minimum additional costs. That means that TEC might make sense even for mid-side corporations who have IT specialists that can learn Prolog and which have need and desire to do complex correlation of events to minimize noise and make event processing more useful for the corporation.
See also
SG245013 Maintaining Your Tivoli Environment Chapter 4. Maintaining the Tivoli availability environment
- 4.1 Tivoli Enterprise Console (TEC)
- 4.1.1 Understanding TEC
- 4.1.2 Maintaining TEC
- 4.1.3 Troubleshooting TEC
- 4.1.4 Optimizing TEC
- 4.1.5 Self monitoring TEC
- 4.2 Rule base
- 4.2.1 Understanding rule base
- 4.2.2 Maintaining rule bases
- 4.2.3 Troubleshooting rule bases
- 4.2.4 Optimizing rule base
|
This interim fix provides files to enable running of the IBM Monitoring Agent for the Tivoli Enterprise Console.
Date: 8/31/2006
General Description: This interim fix provides critical updates to the TEC Server to support the enablement of the IBM Monitoring Agent for Tivoli Enterprise Console. This agent provides monitoring of the TEC server components and event flows as well as Situations, Workspaces, and Take Action commands in the IBM Tivoli Enterprise Portal (TEP). The TEP monitoring environment is provided to TEC customers by a limited use license of the IBM Tivoli Monitoring V6.1 components. The TEC Health Agent is provided to TEC Customers.
Please see the Patch Readme and Health Agent Readme for more information. Additionally, the Tivoli InfoCenter has been updated with the User's Guide for the Health Agent.
The Health Agent is available via Passport Advantage:
http://www-142.ibm.com/software/sw-lotus/services/cwepassport.nsf/wdocs/passporthome
Current TEC customers will go to the Passport Advantage site like they normally do and put in their subscription number and then be presented with their entitled products. The part numbers for the Health Agent images are: C944JML, C945XML, C945YML, C94MIML, C94MJML.
Refer to e-assemblies: CR0YQML (AP) and/or CR0YPML (non-AP).
Additionally, there is a new "Tivoli Monitoring for TEC" User's Guide in the TEC InfoCenter:
http://publib.boulder.ibm.com/infocenter/tivihelp/v3r1/index.jsp?toc=/com.ibm.itec.doc_3.9/toc.xmlPrerequisites
IBM Tivoli Enterprise Console Version 3.9
IBM Tivoli Enterprise Console Version 3.9 Fix Pack 5 (3.9.0-TEC-FP05)
This tool is a command line utility which runs under UNIX and the BASH shell under Windows. It takes the command line arguments, validates them, builds an SQL query, runs the "wtdumper -w" command with the query, and formats the output based on command-line switches.
The command line arguments consist of sets of event attribute names, and the value to search for in the database. A display parameter is also required.
For example, the following command will search the event repository for all TEC_Notice events with a hostname of host1, and will display all matches:
./query_er.sh -class TEC_Notice -hostname host1 -da
Disclosed by International Business Machines Corporation
Whats New in 3.9.0-TIV-TEC-FP0007: Tivoli Enterprise Console Fixpack 7
Fixpack 7 was released on September 28, 2007 and there are some new features as well as fixes for known problems. In this STE, we will cover both those new features and troubleshooting those known problems.Installing the Tivoli Enterprise Console Web Console with WAS in Network Deployment Mode
This STE will cover installing the Tivoli Enterprise Console Web Console in a Network Deployment Environment.Warehouse Enablement Pack EC2 - Tivoli Enterprise Console
This web seminar will provide a detailed overview on how data is transferred from the TEC Database to the warehouse. Best practices for troubleshooting and recovery will be discussed.Installing Tivoli Enterprise Console V3.9 on Linux for System z.
This STE will explain the necessary steps to install the Tivoli Enterprise Console server components on SUSE 9 linux for System z. We will go through the install for the Framework and DB2 and answer any questions that you may have on the topics.Tivoli Enterprise Console 3.9 Windows Event Adapter Overview
This STE will cover the installation and configuration options for the Windows Event Log Adapter. The latest enhancements and function changes to the adapter will also be discussed.IBM Support Assistant - Tivoli Enterprise Console v3.9
This will discuss how ISA implemented w/ the TEC integration piece will allow users to search databases and learning materials to understand the product, and will provide a collection utility that contains information from where the ISA is installed. Prerequisite:TEC 3.9 w/ Fixpack 4 or Fixpack 5.Setting The Tivoli Enterprise Console Event Viewer Information button
We will discuss how to set up the Tivoli Enterprise Console (TEC) Java Console Information buttonURGENT: Daylight Saving Time changes will affect IBM Tivoli Enterprise Console
Information about the impact of recent Daylight Savings Time changes such as the US Energy Policy Act of 2005, which changes the effective dates of US Daylight Saving Time (DST) in 2007 for the US. Actions are required to address these issues in IBM Tivoli Enterprise Console.New Zealand Daylight Saving Time (DST) Changes: Information for IBM Tivoli Enterprise Console
New Zealand has extended Daylight Saving Time. DST will start one week earlier than usual on 30 September 2007 instead of the first Sunday in October and it will end two weeks later on 6 April 2008 instead of the third Sunday in March. Systems and applications that process dates and times will be affected by this change. If no action is taken, computers and applications that use local time will be off by one hour for the first week in October, the last two weeks in March, and the first week in April.Information about 3.8.0-TEC-ELFALA and what it provides
There is reference to a Limited Availability interim fix entitled 3.8.0-TEC-ELFALA that is available for download by contacting Tivoli Customer Support. 3.8.0-TEC-FP02 also delivered this code.3.9.0.6-TIV-TEC-LA0057 IBM Tivoli Enterprise Console Version 3.9 Interim Fix
This limited availability interim fix allows a tec_gateway profile to be distributed when the tec_gateway configuration directory does not exist.3.9.0.6-TIV-TEC-LA0058 IBM Tivoli Enterprise Console Version 3.9 Interim Fix
This limited availability interim fix provides an update to the TEC SNMP adapter.3.9.0.7-TIV-TEC-LA0080 IBM Tivoli Enterprise Console Version 3.9 Interim Fix
This limited availability interim fix provides a fix to TEC Gateway Receiver (tec_gwr) component.3.9.0.7-TIV-TEC-LA0078 IBM Tivoli Enterprise Console Version 3.9 Interim Fix
This limited availability interim fix provides a fix to tec_dispatch component.3.9.0.7-TIV-TEC-LA0079 IBM Tivoli Enterprise Console Version 3.9 Interim Fix
This limited availability interim fix provides a fix to the tec_rule component.3.9.0-TIV-TEC-FP0007 IBM Tivoli Enterprise Console Version 3.9 Fix Pack 7
IBM Tivoli Enterprise Console Version 3.9 Fix Pack 7 will include all APAR solutions completed since the release of Fix Pack 6. Updated 2007/11/063.9.0-TIV-TEC-FP0008 IBM Tivoli Enterprise Console Version 3.9 Fix Pack 8
IBM Tivoli Enterprise Console Version 3.9 Fix Pack 8 will include all APAR solutions completed since the release of Fix Pack 7.3.9.0.7-TIV-TEC-LA0077 IBM Tivoli Enterprise Console Version 3.9 Interim Fix
This limited availability interim fix provides a fix to TEC endpoint adapters.Running "wtdbspace" command fails because of a heap size issue
Error message as follows: sql2310N The utility could not generate statistics. Error "-973" was returned. SQL0973N Not enough storage is available in the "<heap-name>" heap to process the statement. .Tivoli Enterprise Console Program Directory
Provide online copies of the available IBM Tivoli Enterprise Console program directories.TEC SNMP adapter fails to send events
The tecad_snmp adapter should be sending events to the TEC server based upon the traps that it reads and parses as according to the tecad_snmp.cds and tecad_snmp.oid definition files. Sometimes this fails.All TEC tablespaces are full
The "wtdbspace" output does not reflect it, there are not any error messages returned and everything seems to be working fine. But DB2 log shows that tablespaces are full and there are some warning messages when running "wtdbspace" or other DB2 commands.BIMprolog returns *** RUNTIME 600 *** message
./BIMprolog ProLog by BIM - release 4.0.10i - 25-Apr-1995 Copyright (c) 1985-1995 BIM Engineering Europe *** RUNTIME 600 *** File /var/tmp/prologI/interpreter/bin/lib/system.pro non-existent or not a regular file.ADM6017E;SQL0968C error on TEC 3.9 EC2_c05_s040_src_load
CDWEX8087E; ADM6017E; SQL0968C The file system is full. SQLSTATE=57011 TEMP_TWH32K container too small.rule does not trace after adding directive: trace
In trying to test a new rule, the directive: trace is added to the rule but there is nothing in the rules.trace file that is created.The file only contains the name of the ruleprevent UDP packets from being sent when using postemsg.exe
A configuration file is being used with the postemsg.exe and ServerPort (set to a valid port other than 0) and ServerLocation are specified. But UDP packets are still being sent and causing problems with firewall logs etcChanging the RIM database user ID
The TEC database was created by the db2inst1 user id in the db2inst1 instance, Now customer's site has a requirement to change the database useridConfiguration file associated with the windows adapter
What does the NewLogBasedOn value do in the tecad_win.conf file?Efficient Memory management within a rulebase
How can Prolog Heap Table utilization be monitored with the rulebase?Windows 2003 Server with SP1 on Tivoli Enterprise Console
Fixpack 4 for TEC 3.9 provides support for Windows 2003 with Service Pack 1 installed.Limitation of TEC 3.9 Install Assistant
The Web Console was updated in Fix Pack 4 to support WAS 5.1\6.0 and Fixpack 5 allowed for WAS 6.1 but the Install Assistant was not updated to support installing these versions of WebSphere.TEC adapters on Solaris 10 ix86 ?
3.9.0 FP06 Readme does not list if this is supported.CDWEX8087E SQL0530N ETL EC2_c05_s040_src_load
Running the EC2 reports for TDW reports, get the following error: SQL0530NTivoli Platform and Database Support Matrix
Platform and Database support for all Tivoli productsClose or Acknowledge events fail from the Java console
An attempt to modify events from the TEC 3.9 fixpack 4 Java console fails if there is operator inactivity for a certain period of time. Customer has tried the "tec_ui_server_conn_keepalive_interval" option in the ui_server to no avail.Removing additional Tivoli Regions from the TEC Web Console Menu
The procedure to remove unwanted Tivoli Regions from the TEC Web Console login pull down menuTEC install fails when using the Installation Assistant
Using the Tivoli root user, the following error occurs and the installation fails: (May 9, 2006 7:18:23 AM), Setup.product.install, com.tivoli.tec.install.wizard.actions.TMRUnixServerPreChecks, dbg, Current user is NOT within context of TMRThe wsetemsg command fails
Customer's custom script is being executed via a rule, but the wsetemsg in the script fails. Manual execution of the wsetemsg produces the following error: Error::ECO:0001:1473 Command TEC_DB_GET_EVENT failedInstalling the Tivoli Enterprise Console Web Console with WAS in Network Deployment Mode
Audience: TEC users and Administrators that utilize the TEC Web Console Abstract: Installing the Tivoli Enterprise Console Web Console in a Network Deployment Environment Presented by: Ted Douglas, L2 Support Engineer Date: November 12, 2007Part 2 of 2: IBM TEC with Netcool Omnibus - TEC to Omnibus Details
Audience: Any site which has both TEC and Omnibus, or is looking towards a first step in migration from TEC to Omnibus Abstract: This STE follows on from the previous overview presentation. It also is based on Omnibus being the ‘master’ system and looks in more detail at the TEC rules, Omnibus database definitions and TivoliEif probe rules used for this Integration. The presentation will cover the Initial forwarding from TEC to Omnibus and also subsequent updates made to events on TEC or OmnPart 1 of 2: IBM TEC with Netcool Omnibus - TEC to Omnibus Overview
Audience: Any site which has both TEC and Omnibus, or is looking towards a first step in migration from TEC to Omnibus Abstract: This STE provides an overview of Integration of TEC with Omnibus. The presentation is based on Omnibus as the ‘master’ system, with TEC forwarding events to Omnibus. Backwards synchronization are also covered. Presented by: David Leftwich, Technical Support Consultant Date: October 29, 2007What's new in 3.9.0-TIV-TEC-FP0007 TEC Fixpack 7
Audience: IT Staff supporting TEC product Abstract: Fixpack 7 was released on September 28, 2007 and there are some new features as well as fixes for known problems. This STE will cover both those new features and some fixes for known problems. Presented by: Sandi Comsudi, Tivoli Enterprise Console Support Engineer Date: October 25, 2007Redpaper - Creating EIF Events with Tivoli Directory Integrator for Tivoli Netcool/OMNIbus and Tivoli Enterprise Console
This IBM Redpaper describes a solution developed for IBM Tivoli Directory Integrator integration with the IBM event management offering products, IBM Tivoli Netcool/OMNIbus and IBM Tivoli Enterprise Console. This integration solution illustrates an integration scenario aimed toward improving Tivoli Directory Integrator's integration capabilities and leveraging these capabilities with IBM event management offering products. Along with examples, we discuss the architecture behind this approach. This document is divided into several sections. For those readers who are not familiar with the IBM products covered in this Redpaper, we provide a brief overview of Tivoli Directory Integrator, Tivoli Netcool/OMNIbus, and Tivoli Enterprise Console. We then cover the integration with Netcool/OMNIbus and describe an architectural overview and the implementation, installation, and configuration for Tivoli Directory Integrator integration with Netcool/OMNIbus. Similarly, we discuss the integration with Tivoli Enterprise Console and describe an architectural overview, and the implementation, installation, and configuration for Tivoli Directory Integrator integration with the Tivoli Enterprise Console. We discuss additional details about the EIF EventSender component, because it represents a key component that was developed as part of this Redpaper integration. Finally, we document the additional files that ship along with this Redpaper and links to various official documentation.Tivoli Enterprise Console 3.9 Windows Event Adapter Overview
Audience: Tivoli Administrators and Operators, Windows Administrators Abstract: This STE will cover the installation and configuration options for the Windows Event Log Adapter. The latest enhancements and function changes to the adapter will also be discussed. Presented by: Jerry Swan, TEC L2 Support Engineer Date: October 16, 2007Setting The Tivoli Enterprise Console Event Viewer Information button
This Tivoli Support Technical Exchange web seminar will cover how to set up the Tivoli Enterprise Console (TEC) Java Console Information button Presented by: Ted Douglas, Staff Software Engineer Date: August 21, 2007Installing Tivoli Enterprise Console 3.9 on Linux for z/OS
This STE will explain the necessary steps to install the Tivoli Enterprise Console server components on SUSE 9 linux for System z. We will go through the install for the Framework and DB2 and answer any questions that you may have on the topic. Presented by: Jerry Swan, Tivoli Americas TEC L2 Support Date: August 1, 2007Debugging Tivoli Enterprise Console 3.9 logfile adapter problems
This STE will present the various troubleshooting techniques available for TEC 3.9 when working with either the Windows logfile adapter or the unix logfile adapter. This will apply to both TME or non-TME installations. Presented by: Sandi Comsudi, L2 Customer Support Engineer. Date: June 21, 2007 You must prepare and perform a systems check at this location in order to attend the Virtual Classroom. http://asp22.centra.com/SiteRoots/main/SystemCheck/SystemCheck.jhtml?Installing and Configuring Tivoli Enterprise Console 3.9 Feature Option 1
This Web Seminar is intended for IBM customers and business partners interested in monitoring events using the Common Event Infrastructure and converting to those events to TEC - formatted events. It will describe IBM Tivoli Enterprise Console 3.9 Feature Option #1 with emphasis on installation and configuration. Presented by: Randy Hill, IBM Support Engineer Date: June 12, 2007IZ07722: TEC_GWR LEAKS MEMORY IN THE LCF UPCALL LOGIC
Problem Description: tec_gwr leaks memory in the lcf upcall logicIZ08699: TEC FP07 JRE UPDATE DOES NOT STOP THE TEC GATEWAY PROCESS ON MACHINES RUNNIGN MULTIPLE OSERV'S
ENV: WindowsIZ07909: TRANSLATE 3.9 FP07 FIXPACK READMES
fp7 translated readmes need to be publishedIZ06153: WSTARTMAINT.SH DOES NOT WORK WHEN THE DATE SPANS A MONTH
Problem Description:wstartmaint.sh does not work when the date spans a monthIY64197: THE START_MAINTENANCE TASK INCORRECTLY ADD A DAY TO THE DESIRED START DATE WHEN THE WDATE IS A DAY BEHIND THE LOCAL DATE.
The start_maintenance (wstartmaint.sh) task incorrectly add a day to the input start date when the wdate is a day behind theIZ07428: TECWINADAPTER GOES DOWN WITH DRWATSON ERROR WHEN FQDOMAIN=YES IS SET IN ADAPTER CONFIG.
Problem Description: TECWINAdapter goes down with Drwatson error when FQDomain=YES isIY99920: GARBLED CHARACTERS FROM AS400 LOGFILE ADAPTER WHEN MSGQ DATA HAS0X7D AS PART OF DOUBLE BYTE DATA (E.G 0X487D).
Problem Description: Garbled characters from AS400 Logfile adapter when MSGQIZ07237: VALUE OF INTEGER SLOT NOT CORRECT INTERPRETED AND REPLACED BY DEFAULT_VALUE
Problem Description: value of integer slot not correct interpreted and replaced by default_valueIY99731: EVENTS FROM NETVIEW ADAPTER PARSE_FAIL AT THE TEC SERVER
Problem Description: .IY95507: EC2 PERL SCRIPTS CREATE .POSTEDIT FILES WITH UNQUOTED ZERO, THAT ARE TRANSFORMED IN UNEXPECTED NULL WHEN LOADED
EC2 Perl scripts create a file .postedit where all the lines to be loaded in tables are written. These lines should have all the
This add-on to the Tivoli Enterprise Console 3.9.0 product adds support for event sources using the Web Services protocol and integration with the Common Event Infrastructure.
The Tivoli Enterprise Console 3.9.0 product supports a large number of event adapters and event sources, ranging from SNMP traps to events coming from products such as Tivoli Business Systems Manager.
The Tivoli Enterprise Console Feature Option introduces three major components:
- (1) an additional event adapter for event sources using Web Services invocations;
- (2) an extension to a Common Event Infrastructure event server running inside a WebSphere Application Server to enable event forwarding directly to a Tivoli Enterprise Console server; and
- (3) a Web Services event receiver for a Common Event Infrastructure event server running inside a WebSphere Application Server
The new event adapter is called the Enterprise Console Web Services Adapter: a standalone process that can receive events through Web Services invocations and forward these events to an Enterprise Console server. This adapter implements a subset of the Web Services Notification specification, which is promoted by the Organization for the Advancement of Structured Information Standards (http://www.oasis-open.org) and supported by other major software vendors. This new feature allows a Tivoli Enterprise Console operator to manage events produced by event sources using Web Services invocations, such as event sources based on the IBM Autonomic Computing Toolkit (http://www.ibm.com/developerworks/autonomic).
As background for users still not familiar with the Common Event Infrastructure, it is an integral part of the IBM WebSphere Process Server product (http://www.ibm.com/software/integration/wps) and also a key event integration technology within IBM next generation of products.
The event forwarding extension is called the EIF WebSphere JMS Provider and augments the WebSphere Application Server messaging capabilities with support for converting the event format used by the Common Event Infrastructure to the EIF (Event Integration Facility) format used by a Tivoli Enterprise Console event server. This new feature allows a Tivoli Enterprise Console operator to manage events produced by event sources such as the IBM WebSphere Business Monitor product (http://www.ibm.com/software/integration/wbimonitor).
The Common Event Infrastructure Web Services Receiver uses the same Web Services interface used by the Enterprise Console Web Services Adapter. When combined with the EIF WebSphere JMS Provider, this receiver allows a Tivoli Enterprise Console administrator to route events through a Common Event Infrastructure event server before forwarding a copy of the event to a Tivoli Enterprise Console event server. The combination of these two features enables event management through the Tivoli Enterprise Console graphical interfaces at the same time it also allows events to be used for business process monitoring in the IBM WebSphere Business Monitor product.
More information about Common Event Infrastructure can be found at http://www.ibm.com/software/tivoli/features/cei/.The Tivoli Enterprise Console Feature Option requires TEC 3.9.0 with Fix Pack 4 or greater.
The Tivoli Enterprise Console Web Services, when running on a machine remote from the Tivoli Enterprise Console event server, requires Java (TM) Runtime Environment 1.4 and above.
The EIF WebSphere JMS Provider and the Common Event Infrastructure Web Services Receiver require the Common Event Infrastructure event server installed on WebSphere Process Server (WPS).
This article outlines a possible solution for both Tivoli Management Environment (TME) and non-TME utility agents to minimise the delay in delivering events to the Tivoli Enterprise Console (TEC) server. The aim is to facilitate normal operations, such as service level agreement (SLA) evaluation and timer rule execution, within the rule base.
It is always advisable to provide a highly available infrastructure for event management. This will result in delayed delivery of the TEC events as they are cached on the component that detected the failure.
If caching occurs at the gateway/tec_gateway, automatic flushing of the cached event (already built in the component) is initiated when the connection to the TEC server is re-established. This is the standard behaviour of the tec_gateway.
IntroductionWhen configured appropriately, the Tivoli Enterprise Console (TEC) server can provide a very strong event management infrastructure – even for the largest IT environment. One key aspect of such an environment is robust event delivery. TEC provides several features for such a fault-tolerant and resilient delivery, but it requires the affected components at the event source to be configured correctly.
Even with careful planning and configuration for event forwarding, have you ever wondered why TEC events are not seen at the TEC server when expected? Or why you experience a delayed delivery of the events?
This article discusses the reasons why delivery can be delayed and where TEC events are cached. Possible solutions to manage this – both for Tivoli Management Environment (TME) and non-TME events – are provided, as well as solutions for flushing cached events when standalone utilities (for example wpostemsg and postemsg) are used for event forwarding.
Did you know that IBM Tivoli Training offers free training every month? Did you know that you only have to visit one web page to find a list of all the training that is currently free? The list is sorted by product and currently lists over 70 free Web Based courses. For details on IBM Tivoli Training that is currently free go to: http://www.ibm.com/software/tivoli/edu cation/edu_prd_free.html
Check the above link and this web page at least once each month for special offers.Free IBM Tivoli Training Roadmaps
Not sure which Tivoli course you should take? What about prerequisites or product certification? You need a Skills Roadmap. BM Tivoli Training has individual Skills Roadmaps available for a majority of our products. The roadmaps list the prerequisite requirements, classroom courses, Web Based Training courses, certification information and other education (white papers, RedBI). The Skills Roadmaps are in PDF format and can be downloaded individually or combined in a single . compressed file from: http://www.ibm.com/software/tivoli/edu cation/eduroad_prod.html
Check out the TOP 10 most recent downloads from the Tivoli Information Exchange:
1) Best Practices on Monitoring 6.1 and more
2) ITM6 agent remote configuration
3) Tivoli Monitoring data sheet
4) "2006 - Takeaways- ITM and IT Process Mgrs tech pr
5) "2006 - Takeaways - TEC, Netview, TPM, TCM tech pr
6) Chicago TUG Endpoint Health scripts
7) Process events from wtdumprl
8) List running desktops
9) T/EC event hit report
10)"2006 - Takeaways - TDW,TBSM, TSLA, ITCAM tech pre
More downloads here!
The intent of the paper is to address some of the more important aspects of design and implementation of a DB2 database system in a concise manner, while referring the reader to additional references for more detail.
While much of this material is applicable to DB2 on all available platforms, this paper specifically deals only with DB2 on distributed platforms, i.e. Windows, UNIX, and Linux. The material was obtained from readily available publications on DB2 and from over 18 years experience with designing, developing, and tuning DB2 systems. While DB2 specific, many of the concepts are applicable to Relational Databases in general, such as Oracle and Microsoft SQL Server.
Following the tuning advice in the document will improve the performance of any solution that utilizes DB2 as its backend database platform. This tuning information is extremely relevant for many of the Tivoli products and solutions that use DB2 databases; ITM, TEC, TPM, TCM, TSM, TSLA, TADDM, CCMDB, TDW, Monitoring, Provisioning, Identify, Storage, Discovery, Directory, Warehouse, etc.
By tuning the database, you will gain significant performance improvements. The document describes in detail many of the most important aspects of DB2 database design and implementation. It identifies techniques and parameters that have a significant impact on DB2 performance and helps the reader focus on the most important items.
This paper discusses the integration between IBM Tivoli Monitoring 6.1 and IBM Tivoli Enterprise Console 3.9 with them working in conjunction, yet exploiting their specific strengths, for the monitoring and event management spaces.
It describes a simple end-to-end scenario that can help someone get started. It also discusses different configurations of this integration based on different event loads, such that specific environments are properly configured to run smoothly and efficiently without interruptions to service. Some scenarios and their workarounds are also discussed in case of network connectivity failure between Enterprise Console and the Tivoli Monitoring 6.1 TEPS server.
Provider: IBM
NavCode: 1TW10TM2D
Right now, OpenESM has OpenESM for Monitoring v1.3. This release of the software is a combination of Zabbix, Apache, Simple Event Correlation and MySQL. Out of the box, we provide monitoring - warehousing of monitoring data - SLA reporting - correlation and notification. We offer the source code, but we also have a VMWARE based appliance.
Prerequisite: TEC 3.9 w/ Fixpack 4 or Fixpack 5.
It will be presented by David Leftwich on January 18, 2007.
April 11, 2007 (www.gulfsoft.com)The State Based Correlation Engine (SCE) is a powerful tool for filtering and applying simple correlation rules to TEC events before TEC rules are applied, but a major deficiency is a lack of a general purpose action for manipulating events. In order to manipulate events in ways other than the simple methods provided by the supplied actions, one had to develop a new Java class.
Presented here is a general purpose SCE action that embeds the Rhino JavaScript engine that enables the use of JavaScript programs to manipulate events.
This article credit goes to IV Blankenship. Tivoli documentation says there is no way to send ITM events to multiple TEC servers, which is true. However, there is an intelligent workaround for this problem. This article gives you an idea of how to do it.
The idea is to forward the situation events to SCE and write a custom action to forward to multiple event servers. The following java class shows how to send events to single TEC server, which can be tweaked to send events to mulitple TEC servers by modifying the code to to accept multiple sender config files. If you have any questions on how to do it, please feel free to post your comments.
The Java code can be downloaded from <a href=http://www.gulfsoft.com/downloads/TECForwarder.java.zip>here
OK, now I'm treading on sacred ground...
Obviously hardware matters since both are CPU driven applications, but assuming we're dealing with like hardware, the answer is it depends...
TEC
IBM has published benchmarking speeds of the TEC rule engine (a while ago with TEC 3.8 FP whatever running on AIX) at ~65 events per second.
How did they come to derive this number? They start a timer when events are flowing at TEC and stop the timer when the CPU on TEC goes below 5% used.
Is that a good measurement? Maybe, but IMHO not a good way to tell whether the rule engine is really done processing an event, that's for sure. It would be better to actually measure whether the event is PROCESSED in the reception log to really know when th TEC is around ~65 events per second. Of course that is without running any real rules against the incoming events. Another factor to consider is I.V., who as we all know has achieved 300+ events per second using his non-tme rule engine.
Netcool Omnibus
Based on what I've heard in the past from MicroMuse when asked how fast Omnibus processes events, I've heard "thousands of events per second". When we drilled deeper and asked more questions, we were told those were "raw" events and it's more like "hundreds of events per second". What is unclear is whether these events were acted upon by any rules (i.e. is this merely event reception speed). Unfortunately, I don't have any hard benchmarking numbers to share at this point until I get my hands on Netcool code.
So based on this, it really depends on a number of factors such as what kind of rules are you running against your events, how you tell when an event is "processed" by the rule engine, and whether or not you are I.V. ;-)
The Tivoli Enterprise Portal (TEP) provides rich visualization out of the box, and with the Enterprise Console workspace plug-in, network and other non-ITM events can be managed from one interface. With a combination Universal Agent and TEP ODBC query you can create a TEC centric workspace to view TEC events and monitor TEC itself.
Use the following instructions to upgrade the Web console component of the IBM Tivoli Enterprise Console (ITEC) Version 3.9 product. These instructions apply to all ITEC fix packs (These instructions use Fix Pack 3, 3.9.0-TEC-FP03, as an example.)
Use the files from the NON_TME/GENERIC/WC directory of the fix pack and perform the following steps:
1. Copy tecrimds.jar to the AppServer/TEC directory of the WebSphere Application Server installation, overwriting the existing file.
2. Update the TecConsoleEar.ear file from the WebSphere Administrative Console:
a. In the panel on the left, click the plus sign (+) next to Applications, and then select Enterprise Applications.
b. In the panel on the right, check the box next to TecConsoleEAR. Click Update.
c. Check Local path or Server path, depending on where the 3.9.0-TEC-FP03 version of TECConsoleEAR.ear is located. Enter the path to the 3.9.0-TEC-FP03 version of TECConsoleEAR.ear in the appropriate path field. Click Next.
d. At the "Preparing for the application update" panel, accept all defaults and click Next.
e. At steps 1, 2 and 3 of the "Install New Application" panel, accept all defaults and click Next. Please note that none of the options are checked in step 2, including the TecConsoleWeb option. This is the expected behavior, and there is no need to select the TecConsoleWeb option in this step.
f. At step 4 of the "Install New Application" panel, click Finish.
g. Once the application is installed, click the "Save to Master Configuration" link.
h. When prompted to "Click the Save button to update the master repository with your changes", click Save.
3. Use the winrar utility to extract tecra.rar to the AppServer/InstalledConnectors/tecra.rar directory of the WebSphere Application Server installation, overwriting the existing files and folders.
The fix pack installation is complete. Restart WebSphere Application Server, the event server, the UI server, and all consoles.3.9.0-TEC-FP05 IBM Tivoli Enterprise Console Version 3.9 Fix Pack 5 IBM Tivoli Enterprise Console Version 3.9 Fix Pack 5 will include all APAR solutions completed after the release of Fix Pack 4. This fix pack is scheduled to release on June 30, 2006.
Tivoli Enterprise Console can be rightly called the flagship of the Tivoli product line because it is the focal point of events from all Tivoli products. The new version of TEC will bring very important usability and performance enhancements such as Java-based TEC Console and Availability Intermediate Manager (AIM).
This redbook introduces the new Tivoli Enterprise Console V3.7, covering the installation, tailoring, and configuration of the console itself along with an overview of the new Availability Intermediate Manager (AIM) feature. Richly illustrated with examples and sample screens, Early Experiences with Tivoli Enterprise Console 3.7 is an invaluable resource for customers and Tivoli professionals, whether they will migrate to TEC 3.7 from a previous version or implement it from scratch.
This book will help you to use the new rules templates bundled with TEC V3.7 as well as the Tivoli Decision Support for Event Management Guide. It also provides an invaluable troubleshooting guide that provides both general and specific tips for debugging and optimizing the new console.
[PDF] Tivoli on Linux
TEC Information Center -- the list on major TEC documents. This link is very difficult to find via IBM site ;-)
SG245013 Maintaining Your Tivoli Environment Chapter 4. Maintaining the Tivoli availability environment
- 4.1 Tivoli Enterprise Console (TEC)
- 4.1.1 Understanding TEC
- 4.1.2 Maintaining TEC
- 4.1.3 Troubleshooting TEC
- 4.1.4 Optimizing TEC
- 4.1.5 Self monitoring TEC
|
Tivoli Software Global User Group Community
Early Experiences with Tivoli Enterprise Console 3.7 Published 20 November 2000
IBM Redbooks Maintaining Your Tivoli Environment
[PDF]
Aggregation and Correlation of Intrusion-Detection Alerts
File Format: PDF/Adobe Acrobat -
View as HTML
... is implemented on top of the Tivoli Enterprise Console ...
engine that sits inside the
TEC and processes ... However, given the complexity of the
processing required ...
perso.rd.francetelecom.fr/debar/papers/DebWes01.pdf -
Similar pages
User Groups
FAQ
IBM Tivoli software training course - IBM Tivoli Enterprise Console 3.9
- How can I display a summary of event counts?
- How do I view % events by class
- How do I get summary counts of events in the last 10 minutes?
- How can you identify the Managed Node Hosting the TEC Server?
- How can you identify the Managed Node Hosting the TEC Server?
- What does the DB2 error SQL1224N mean when I try and start my TEC server?
- How do I test my RIM connection?
- How do I create a TEC User for use with TEC Console 3.7.x?
- How do I create an Event Console for TEC Console 3.7.x?
- How do you compile a prolog source file.
- Which file was an event generated from?
- Filtering events by date and time directly from the format file
- What does %t really mean in a format file
- How can I match on a specific number of characters in a format file
- How to remove the complete "Source Group" Display from TEC Console
- How to speed up startup of the Event Console
- How do I run a query against my RIM database?
- How do I create and load a new Rule Base?
- How do I delete all events quickly?
Etc
The following documents are available in the IBM Tivoli Enterprise Console library:
Provides information about supported adapters, including how to install and configure these adapters.
Provides details about IBM Tivoli Enterprise Console commands, predefined tasks that are shipped in the task library, and the environment variables that are available to tasks that run against an event.
Describes how to install, upgrade, and uninstall the IBM Tivoli Enterprise Console product.
Provides release-specific information that is not available until just before the product is sent to market.
Describes how to develop rules and integrate them for event correlation and automated event management.
Provides reference information about the IBM Tivoli Enterprise Console rule sets.
Provides an overview of the IBM Tivoli Enterprise Console product and describes how to configure and use the IBM Tivoli Enterprise Console product to manage events.
Describes how to install and configure the warehouse enablement pack for the IBM Tivoli Enterprise Console product and describes the data flow and structures that are used by the warehouse pack.
Describes how to develop your own event adapters that are tailored to your network environment and the specific needs of your enterprise. This reference also describes how to filter events at the source.
The Tivoli Software Glossary includes definitions for many of the technical terms related to Tivoli software. TheTivoli Software Glossary is available, in English only, at the following Tivoli software library Web site:
http://www.ibm.com/software/tivoli/library/
Access the glossary by clicking the Glossary link on the left pane of the Tivoli software library window.
If you have a problem with any Tivoli product, refer to the following IBM Software Support Web site:
http://www.ibm.com/software/sysmgmt/products/support/
If you want to contact software support, see the IBM Software Support Guide at the following Web site:
http://techsupport.services.ibm.com/guides/handbook.html
The guide provides information about how to contact IBM Software Support, depending on the severity of your problem, and the following information:
User groups provide software professionals with a forum for communicating ideas, technical expertise, and experiences related to the product. They are located on the Internet and are available using standard news reader programs. These groups are primarily intended for user-to-user communication and are not a replacement for formal support.
Copyright © 1996-2008 by Dr. Nikolai Bezroukov. www.softpanorama.org was created as a service to the UN Sustainable Development Networking Programme (SDNP) in the author free time. Submit comments This document is an industrial compilation designed and created exclusively for educational use and is placed under the copyright of the Open Content License(OPL). Original materials copyright belong to respective owners. Quotes are made for educational purposes only in compliance with the fair use doctrine.
Standard disclaimer: The statements, views and opinions presented on this web page are those of the author and are not endorsed by, nor do they necessarily reflect, the opinions of the author present and former employers, SDNP or any other organization the author may be associated with. We do not warrant the correctness of the information provided or its fitness for any purpose.
Last modified: June 02, 2008