Thursday, August 29, 2013

Teiid (Data Virtualization) and Business Intelligence


This article describes Data Virtualization and Business Intelligence including a step by step demonstration of multisource, federated data virtualization with Teiid/Teiid Designer and the Teiid Dashboard.

Overview

As business intelligence (BI) teams face increasing pressure to perform faster, organizations are quickly adopting agile development methodologies to try and keep up. Join us to learn how virtual, integrated views of data make agile BI development easier.
Respond faster, smarter to business demands

Successful BI teams must be able to implement projects fast and respond quickly to changing business requirements. Agile development can help your business respond to these needs, but as the methodologies are updated, you also have to update the tools and techniques for implementing BI.

Red Hat® JBoss® Data Services is perfectly suited for agile BI teams.

Webinar Recording - http://www.redhat.com/about/events-webinars/webinars/2013-08-29-business-intel-using-data-virt

Slides from the Webinar - http://www.slideshare.net/opensourcementor/delivering-agile-business-intelligence-using-data-virtualization



Demonstration

Source Code - https://github.com/kpeeples/dv-and-bi

Section 1 – Setup
Step 1 - Download JBoss EAP 6.1 from JBoss.org and JBoss Developer Studio 7 (Kepler) http://www.jboss.org/products

Step 2 - Install JBoss Tools which includes Teiid Designer/Runtime 8.2.
http://download.jboss.org/jbosstools/updates/integration/kepler/integration-stack/aggregate/4.1.2/

Step 3 - Install Teiid 8.2, Web Console and Teiid Dashboard into JBoss EAP

(I am using an early release of Data Virtualization 6)
http://www.jboss.org/teiid
http://www.jboss.org/teiiddesigner
https://github.com/teiid/teiid-dashboard

Additional Tools
-SQuirrel SQL Client with Teiid JDBC jar installed
-SOAPUI
-Maven

Section 2 – Teiid Designer
Step 1 - Modify standalone/configuration/teiid-security-roles for admin role for dashboard for user

Step 2 - Add User for the Management Realm - admin/qwer1234@!#$

Step 3 - Add Server in JBDS

Step 4 - Browse to initial applications for verification

a. Access the Web Console - http://localhost:9990/console - with the admin user

b. Access the Teiid Dashboard - http://localhost:8080/dashbuilder/ - with the user user

Step 5 - Build the expenses VDB to enable changing the expenses csv in the dashboard to the expenses VDB

a. Action - Define Teiid Model Project - New, entering ExpensesModelProject and accepting defaults

b. Action - Create a Teiid Flat File Connection

c. Action - Create the source model from local flat file source - use expenseReports.csv

d. Action - Use expenseReports.csv and edit the delimeter as semicolon

e. Action - Preview Data

f.  Action - Define VDB

g. Action - Execute VDB

h. Action - Deploy VDB

Step 6 - Build the federated multisource VDB

Simple example of using a Union View for a federated vdb (on a XML File and a Flat File)

a. Create the data
b. Create the Project
c. Create the Flat File Connection
d. Create the Flat File Source Model
e. Create the XML File Connection
f. Create the XML File Source Model
g. Create a Union View Model
h. Create the Relational View Model
i. Create the View Table
j. Add Source Tables to View Transformation
k. Test the New Model
l. Add an additional column to one datasource

Step 7 - Simple example of MySQL Datasource

Step 8 - Simple example of Web Service Datasource

Step 9 - Test from a Java Program using the Teiid JDBC driver

Section 3 – Web Console

Step 1 - View the Teiid Virtual Databases and datasources in the web console

Section 4 – Teiid Dashboard

Step 1 - Change the expenses sample dashboard to us the Expenses VDB

a. Create the external connection with Teiid

b. Create the Data Source with SQL Query - SELECT office, amount FROM expenseReportsViewTable

c. From the Expense Reports Sample Dashboard, Edit Content on the expenses by Office USD and change the Data provider.  The data should be the same.  The virtual database has abstracted the data.

d. Amount is String error.  Change the data type for the amount field in the VDB and redeploy.  The total amount should have the correct amount.

Step 2 - Create a new Workspace

a. Create a External Connection and Datasource in the Teiid Dashboard

b. Create a Workspace, page and panel with KPIs using the VDBs from above

References:

https://community.jboss.org/wiki/ExampleOfFederatingTwoDataSources

https://docs.jboss.org/author/display/teiid82final/Installation+Guide

Monday, August 19, 2013

Data Virtualization - Teiid Designer

From the Teiid Designer Project Team ....
Teiid Designer 8.2 Final is now available

This release improves our integration with the JBoss Server framework as well as improved metadata import and VDB management support.

Other features include:
  • Support for Teiid 8.4 Final runtime
  • Support for row-based security and column masking in VDB Editor
  • Option to collect cost statistics during JDBC import
  • Improved DDL import via deployed data sources
  • VDB-Model refactoring improvements
Check it out the details on our What's New page...

Thursday, August 15, 2013

Fedora 19 with kernel 3.10 fail to install vmplayer module

Fedora 19 with kernel 3.10 fail to install vmplayer module.

If you are having problem start up vmware player on Fedora 19 after upgrade kernel to 3.10, here is the solution.

Basically it is due to the procfs interface and vmnet not able to compiles.

First download the procfs patch from http://communities.vmware.com/thread/446113?start=0&tstart=0 .If you don't have time to read the forum, here is the link of the procfs patch.

Or you can use the following command:

# tar xf /usr/lib/vmware/modules/source/vmnet.tar
# cd vmnet-only
# wget  http://communities.vmware.com/servlet/JiveServlet/download/2239207-108590/procfs.patch
# patch -p1 < procfs.patch
# cd ..
# tar -cvf vmnet.tar vmnet-only/
# cp vmnet.tar /usr/lib/vmware/modules/source/


This will patch the procfs interface.

Secondly download the vmnet patch from http://mysticalzero.blogspot.com/2013/07/vmblock-patch-for-linux-310-vmware.html. The link of the patch is here.

Or you can use the following command:

# tar xf /usr/lib/vmware/modules/source/vmblock.tar
# cd vmblock-only
# wget  https://sites.google.com/site/mysticalzerotmp/vmblock.3.10.patch
# patch -p1 < vmblock.3.10.patch
# cd ..
# tar -cvf vmblock.tar vmblock-only/
# cp vmblock.tar /usr/lib/vmware/modules/source/

then issue this command to compile and install the vmware player module

# sudo vmware-modconfig --console --install-all

I believe these steps not only work on Fedora 19, it should work on most of the Linux distro with kernel 3.10.

Please let me know if these steps didn't work for your linux.

Tuesday, August 6, 2013

Error executing aapt within eclipse

Although the Android Development Tools (ADT) bundle is available as a zip package for 'Linux 64 Bit' it states following requirements:
64-bit distributions must be capable of running 32-bit applications.
And indeed, just running the packaged eclipse on a Fedora 19 64 bit system results in errors, because it can't 'find' several development tools, e.g. adb or aapt:
Error executing aapt: Cannot run program "/home/juser/local/adt-bundle-linux/sdk/build-tools/android-4.3/aapt": error=2, No such file or directory: error=2, No such file or directory
The 'no such file' is misleading because it is there (under $HOME/local):

adt-bundle-linux/sdk/build-tools/aapt
 
Looking at the file

$ file adt-bundle-linux/sdk/platform-tools/aapt
adt-bundle-linux/sdk/platform-tools/aapt: ELF 32-bit LSB executable, Intel 80386,
 version 1 (SYSV), dynamically linked (uses shared libs), for GNU/Linux 2.6.8,
 not stripped 
 
You have to install the 32 bit glibc:

# yum install glibc.i686
This removes the misleading 'no such file or directory' message when trying to execute a 32 bit binary. With that the 64 bit Fedora system is capable of executing 64 bit binaries.

This also removes the misleading 'not a dynamic executable' message of ldd when calling ldd on a 32 bit dynamic executable.

Now you have to install missing 32 bit libraries the binaries under adt-bundle-linux/sdk/platform-tools are linked against:
 
# yum install zlib.i686 libstdc++.i686 ncurses-libs.i686 libgcc.i686 
 
 
http://unix.stackexchange.com/questions/57863/how-to-run-32-bit-programs-on-64-bit-fedora-17
 

Monday, August 5, 2013

Overlord 1.0.0.Final


Take a look at the major components of Overlord.

1) S-RAMP - SOA Repository Artifact Model and Protocol (based on the OASIS standard)
2) DTGov - Design Time Governance
3) RTGov - Run Time Governance

http://jboss-overlord.blogspot.co.uk/2013/08/overlord-100final-has-been-released.html

Flock to Fedora

Fedora Contributor Conference is this week in Charleston, SC

Flock - Fedora Contributor Conference
Dates: August 9, 2013 - August 12, 2013
Location: Charleston, SC, USA
Main Website: http://flocktofedora.com
Schedule site: http://flock2013.sched.org/