idpt0000

Icon

DataStage Forum (Revisited)

I found that one of the most popular post here is the one recommending datastage resource years ago. It’s time to add the latest information. Apart from DSXchange, you should also check out the following sites :

And just in case you’re also working on Cognos, these may be helpful as well :

Filed under: DataStage, ,

DataStage Revisit

Haven’t work on DataStage directly for years.  However, my two previous post (1) (2) on DataStage information source are still the top one of my blog.  Kind of shame, because this means there are not other more useful stuff after my move beyond DataStage . . .

Anyway, I have to back to DataStage recently for some reasons . . .  and I found that even long long after IBM has acquired Ascential, the tech giant still cannot create a concentrate community for its own product.  Why ?  you can easily found that the posts in DSXhange.com is much much more than that of IBM’s own support forum,   How ironic it is . . .

Filed under: DataStage, 走在最前

What if moving the ETL process to cloud ?

It is already out of everyone’s imagination.  IBM has partnered with Amazon and port DataStage / QualityStage to Amazon’s EC.   Yes, the tech giant has so much buy-in in clouding computing, and eager to move this data intensity tasks from traditional in-house server farm to the cloud-based external data center.  And before we have sort out the disk I/O performance issue, they’ve already moved away to the network / internet.

Filed under: DataStage, 走在最前, , , , ,

Unlock DataStage Object

Just find a useful thread in IBM’s forum : How to unlock a job accessed by another user.  

Removing locks when you receive the error:…Cannot get exclusive access …

1. Login to DataStage Administrator as an administrative user.
2. Go to the Command Prompt for that Project.
3. Look at the locks by executing:

LIST.READU

4. The last column is the item id. Look for item id’s like:

jobname

This is the record you will want to unlock. Now you can note the inode or user no, whichever uniquely identifies the record.

5. The unlock command is not available by default in the projects. To create an entry to use unlock execute the following two commands:

>SET.FILE UV VOC UV.VOC
>COPY FROM UV.VOC TO VOC UNLOCK

Note: This only needs to be done the first time in each project.

6. To unlock by either INODE or User No use the commands:

UNLOCK INODE inodenumber ALL
UNLOCK USER usernumber ALL

Another approach :

1. telnet to DS server machine as ds administrative account (dsadm or root for example);
2. cd to $DSHOME;
3. source dsenv by “. ./dsenv”; (read as dot_space_dot_dsenv)
4. run “bin/uvsh” to enter TCL prompt;
5. run “>LIST.READU EVERY”, are you able to find any lock for the project under Active Record Locks? If yes, mark down the Userno for the command below;
6 run “>UNLOCK USER userno ALL”;
7. run “>LIST.READU EVERY” again to verify the lock for the user is gone;
8. repeat step 6 and 7 until all locks for the project is clear;
9. run “>LO” to exit TCL prompt.
10. try login to the project again.

Filed under: DataStage, ETL, 走在最前,

Access to DataStage Universe

Although DataStage is going to abandon Universe as its repository, it is still useful if you have not yet migrate to version 8. You may also found some useful utilities in the universe admin interface. Here is the details :

(1) To retrieve job information …
$DSHOME/bin/uvsh “select * from DS_JOBS;”

(2) To list and unlock all present lock ….
LIST.READU EVERY
UNLOCK ALL

(3) Invoke admin tool …
DS.TOOLS

(4) To delete and recreate a log file …
DELETE.FILE DATA RT_LOG182
CREATE.FILE DATA RT_LOG182 30

the number in “RT_LOGxxx” can be found using (1) …

Filed under: DataStage, ETL, 走在最前,

DataStage Blog and Wiki

Vincent McBurney is busy with his “expert’s blog” for IBM ETL products. The blog was hosted by ITtoolbox. Severa wiki was created along the DataStage technologies, see (1), (2) ….

Filed under: DataStage, ETL, 走在最前

DataStage Forum

Bad news : DSXchange had introduced a charging scheme for “Premium Content / Premium Membership”. It’s around USD $50 per year. Here is what they said :

Due to the overwhelming growth and success of the DSXchange, it’s time to make a few changes. The forum’s vast amount of information delivers great value to thousands of developers around the globe, and because of its increasingly critical role in the success of DataStage®, its related products, and the projects of so many developers around the world, we must find a way to facilitate the continued operation of this outstanding resource, even in the face of rising support costs.To that end, we are phasing in Basic/Premium division of content on the DSXchange. Chances are you linked to this page from our January Newsletter. However, you also may have landed here by clicking a “Premium Content” button in one of the topics you were reading in the forum. You probably noticed that this button appears over what would have been the contents of a post. This means that the response was written by a “Premium Poster”, and while a few words are revealed to give you some idea of the substance of the response, the majority of the reply will only be accessible to Premium Members.

So who are these Premium Posters? Our Premium Posters consist of over a dozen top-notch consultants and developers with numerous years of experience that have distinguished themselves as experts in the field. Many of these members are already leaders and mentors on this site and elsewhere. As a collective whole, these Premium Posters are a formidable source for knowledge and advice and they are all dedicated to the ongoing existence and success of this community. If you’d like to see a list of our experts check out the article entitled “Premium Posters” on the front page of our website. In addition to premium content within posts, we will soon begin adding new content areas (forums, download areas, etc.) that will only be available to Premium Members.

After a few trial, it seems that the most part of the discussion, i.e. the answer, are all masked as “Premium Content”. So, are those Premium Posters got paid for each click? If not, why they keep provide the solution, and being a free labour for others.

I’m quite shocking for what dsxchange did, turning an community to commerical products. In the theme of Web2.0, we are looking for user participation, while getting the return with the long tail. I also doubt that with all valuable information masked, this forum is going to die out soon.

You may want to try other free resources, like IBM’s official developer forum and Tek-Tips.

Filed under: DataStage, ETL, 走在最前

Follow

Get every new post delivered to your Inbox.