|
More site info...
Data Integration / ETL | Forum profile
|
|
Forum profile page for Data Integration / ETL on http://www.pentaho.org.
This report page is the aggregated overview from a single forum: Data Integration / ETL, located on the Message Board at http://www.pentaho.org.
This forum profile page summarizes the general forum statistics such as: Users Activity, Forum Activity, and Top Authors, which are reported in either a table or graph below for a given reporting time period.
Additional forum profile information for "Data Integration / ETL" on the Message Board at http://www.pentaho.org is also shown in the following ways:
1) Latest Active Threads
2) Hot Threads for Last Week
Warning: These statistics are generated using 'best efforts' and can experience delays and reporting errors at times. Please note that such statistics do not constitute a forum's popularity and/or exact posting volumes at any given reporting period.
|
|
|
|
|
Posting activity on Data Integration / ETL:
|
|
Week
|
Month
|
3 Months
|
|
Threads:
|
70
|
335
|
894
|
|
Post:
|
131
|
760
|
2,153
|
|
|
Data Integration / ETL Posting activity graph:
|
Top authors during last week:
user's latest post:
Help with simple evaluation
Published (2009-11-27 16:14:00)
Both approaches *SHOULD* work... It's a matter of which is going to be easier to maintain in the long run. Personally, if there's the possibility of needing to different things for more than just Country 8, then I would use a transform to set a variable, and then run a transform based on the value of that variable. EG. Job - Transform 1 - - TableInput (get Country ID) - - Map Values (Default B, Country 8 -> A) - - Set Variable...
user's latest post:
Migration Kettle 3.0.1 > 3.2.0
Published (2009-11-23 06:12:00)
Make a backup of the repository. Migrate the repository (there should be some info about that in the Install notes) Install Spoon whereever you like run Spoon Be aware that changes in the repository structure or content took place and you will have to update all instances of PDI (spoon, kitchen, pan).
user's latest post:
Database Locked
Published (2009-11-20 06:36:00)
That sounds highly unlikely vlr. A query doesn't (or shouldn't) perform an exclusive lock on any table. Obviously, the query will remain open until you stop it. That's what the "Stop" button is for...
user's latest post:
Help with simple evaluation
Published (2009-11-27 14:46:00)
Oh, I see... You mean, setting the successfull transformation name in the variable... (Maybe with a previous javascript step) That seems a good idea. I'll try it and let you know. My idea was this: I have a variable that identifies a country (an unique id). So my idea was to detect this value (let's say 8) and if the variable holds and 8, use transformation A. Otherwise, use transformation B. What do yo think? Regards,
user's latest post:
Loading Fact Table
Published (2009-11-27 05:19:00)
You need to populate your dimension tables first, and you must do them completely. By this I mean you must have all required values in the dimension tables before you try and populate anything in the fact table. Once the dimension tables are populated from whatever source data you are using, you can start to load a fact table. Typically you would want to 'match' you incoming fact data to the relevant key(s) in each dimension table....
user's latest post:
Formula doesn't allow...
Published (2009-11-19 07:49:00)
Hi Tagua, thanks for the explanation! Cheers Mark
user's latest post:
Common Database connection For...
Published (2009-11-19 08:08:00)
I am new to Kettle as well. In Informatica they have a facility for achieving something similar. Here, I am not quite sure if they have it or how to achieve it. would be nice to know though...
user's latest post:
Question about steps with...
Published (2009-11-23 07:09:00)
Thanks Gutlez. I knew it kind of made sense but wondered if this was definitely the desired result. I figured when you made copies of a step it would share the rows but I was obviously wrong. No problem anyway. Cheers again!
user's latest post:
Mail component in Transformation
Published (2009-11-23 05:13:00)
well, I wonder that if there are any persons who have used the mail component in transformation.
user's latest post:
Skip duplicate sequential...
Published (2009-11-25 23:22:00)
I can't apply a unique index on the three columns because I only want consecutive rows to be unique for one key.
|
|
|
|
Latest active threads on Data Integration / ETL::
Started 6 days, 18 hours ago (2009-11-23 06:02:00)
by fabianS
Sort the data and use the GROUP BY step. Check the 'unique rows' check-box.
This should help.
Started 2 days, 17 hours ago (2009-11-27 07:43:00)
by Bart.Farasyn
Hi Leon,
If you want a rollback in the same transformation, set "use unique connection" to true.
You can find this option in Transformation setting | Miscellaneous.
If you have to rollback more than one transformation, you have to implement that yourself (keep track of your changes in a separate table and use this to undo what was allready commited)
Hope this helps
Groeten,...
Started 3 days, 7 hours ago (2009-11-26 17:44:00)
by gutlez
There's really not a lot to work with here....
Can you post the config of your Simple Eval entry?
Started 3 days, 16 hours ago (2009-11-26 08:15:00)
by anonim
I thought about using field to rows splitter component, but I had (and still have no idea) no idea what to do next with these rows.
Maybe someone could tell me necessary steps. I have used php for data loading some time ago, but I would like to go the hard way, i.e. use PDI.
Started 2 days, 10 hours ago (2009-11-27 14:06:00)
by leomuler
You can use a getDate() step and after a Calculator to search a month. It´s easier .
Léo
Started 2 days, 19 hours ago (2009-11-27 05:19:00)
by TheFrog
You need to populate your dimension tables first, and you must do them completely. By this I mean you must have all required values in the dimension tables before you try and populate anything in the fact table.
Once the dimension tables are populated from whatever source data you are using, you can start to load a fact table. Typically you would want to 'match' you incoming fact data to the ...
|
|
Hot threads for last week on Data Integration / ETL::
Started 3 days, 7 hours ago (2009-11-26 17:44:00)
by gutlez
There's really not a lot to work with here....
Can you post the config of your Simple Eval entry?
Started 3 days, 16 hours ago (2009-11-26 08:15:00)
by anonim
I thought about using field to rows splitter component, but I had (and still have no idea) no idea what to do next with these rows.
Maybe someone could tell me necessary steps. I have used php for data loading some time ago, but I would like to go the hard way, i.e. use PDI.
Started 6 days, 18 hours ago (2009-11-23 06:02:00)
by fabianS
Sort the data and use the GROUP BY step. Check the 'unique rows' check-box.
This should help.
Started 1 week, 3 days ago (2009-11-19 07:23:00)
by MattCasters
Hi Paul,
I created 50,000 empty files in my tmp folder under Linux.
The "Get File names" step took 2. 7 seconds to grab them.
As such, I think you should be looking at a filesystem or operating system issue.
Under Unix systems, it would be trivial to execute a "find" command to grab the recently modified files you need.
Matt
Started 6 days, 18 hours ago (2009-11-23 06:12:00)
by fabianS
Make a backup of the repository.
Migrate the repository (there should be some info about that in the Install notes)
Install Spoon whereever you like
run Spoon
Be aware that changes in the repository structure or content took place and you will have to update all instances of PDI (spoon, kitchen, pan).
Started 2 days, 17 hours ago (2009-11-27 07:43:00)
by Bart.Farasyn
Hi Leon,
If you want a rollback in the same transformation, set "use unique connection" to true.
You can find this option in Transformation setting | Miscellaneous.
If you have to rollback more than one transformation, you have to implement that yourself (keep track of your changes in a separate table and use this to undo what was allready commited)
Hope this helps
Groeten,...
Started 4 days, 8 hours ago (2009-11-25 16:38:00)
by gutlez
Quote:
Originally Posted by ningli
Couldn't find starting point in this job.
There's no START in your job...
Started 6 days, 19 hours ago (2009-11-23 05:13:00)
by colintodd
well, I wonder that if there are any persons who have used the mail component in transformation.
Started 3 days, 22 hours ago (2009-11-26 02:46:00)
by td_psl
Here's the screen shot of the DB Lookup Step.
I am not using Between operator
.
The transformation basically reads about 1.2 million records from the file and does a lookup on the table to get other details.
Initially, i have checked the enable cache option and had set the cche row size, which is not giving me the performance as expected.
Later i have set the row size to 0, to ...
Started 1 week, 2 days ago (2009-11-20 08:47:00)
by bugg_tb
Quote:
Originally Posted by TheFrog
- [Modified Javascript Value] step (with compatability mode turned off) seems to be not handling data being returned to an existing stream field via the .setValue function. I am seeing that when using the output_field.setValue(var) that the 'function' .setValue does not exist for object output_...
|
|
Size: 108 bytes
