Data Import Via Sqoop From Postgresql To HDFS

Hi everyone,
I had another problem while trying to import or list tables on postgresql
via sqoop.
I am using this command
./sqoop list-databases --connect jdbc:postgresql://
192.168.194.158:5432/pgsql --username pgsql -P
It does see only the tables under the public schema, other are not listed.
i tried to change postgresql user settings now, actually is there any
options to list all tables in my database in sqoop?
OR I need to struggle with user-rights in postgresql?
Thanks.

Hi Fatih,
The list-database tool seems to be working with only one schema at the time. You can specify extra argument --schema to specify schema other than the default "public", for example:
  sqoop list-tables --connect ... -- --schema private_schema
Jarcec

Hi Jarek,
Thanks for your help. But I am using sqoop 1.4.3 but --schema version did
not work for me.

Is there any --schema option to be able to list schemas other than public,
because, I am not able to list other tables under non-public schemas?

Hi Fatih,
the --schema extra parameter was added in 1.4.3 via SQOOP-601. It's however extra parameter and not a normal Sqoop parameter. As a result it needs to be specified in the extra argument section of the command line. For example:
  sqoop list-tables --connect ... -- --schema private_schema
Please do notice the extra "--" between normal sqoop arguments and extra arguments.
You might be interested in taking a look into Apache Sqoop Cookbook [1] where all different types of parameters are further described.
Jarcec
Links:
1: http://shop.oreilly.com/product/0636920029519.do

Hi, Can we import data from MS Access to DFS using sqoop? Thanks PK
  Hi,  Is there some way I can import data from Cassandra into HDFS using Sqoop?  I am usingSqoop  (v1.3.0-cdh3u4) and I can import data from MySQL databases into Hive and Hbase. But I want to get data from Cassandra into HDFS (Hive or Hbase or as flatfile), Any idea on how this can be done? Thanks & Regards, Austin
Hi! I'm trying to import data from hdfs with Build and Push plugin.I installed the Azkaban and Voldemort project, but i don't know what i have to do now.� I have a batch view table in hdfs, but it is not stored as json or avro. Do I need to store this in avro or json? Can somebody help me with this process? i have no idea how do i do this. Thanks!
SGkgU3Fvb3AgZXhwZXJ0cyxJIGFtIHRyeWluZyB0byBpbXBvcnQvZXhwb3J0IE15U1FMIGRhdGEg dG8gSGFkb29wIEhERlMgdXNpbmcgU3Fvb3AyICgxLjk5LjMpLiBJIHdhcyBhYmxlIHRvIGltcG9y dCBhIHRhYmxlIGRhdGEgZnJvbSBNeVNRTCB0byBIREZTIGFuZCBJIHNhdyBwYXJ0aXRpb25zIGZp bGVzIGluIHRoZSBzcGVjaWZpZWQgZGlyZWN0b3J5Lkhvd2V2ZXIsIHdoZW4gSSB0cmllZCB0byBl eHBvcnQgZGF0YSBiYWNrIHRvIE15U1FMLCBpdCBhbHdheXMgZmFpbGVkLiBVbmZvcnR1bmF0ZWx5 LCB0aGVyZSBpcyBubyBlcnJvciBpbiB0aGUgbG9nLiBXaGF0IEkgZGlkIGlzIGluIHRoZSBTcW9v
Hi All, I am trying to export data from HDFS to Oracle database using Sqoop and data direct JDBC with CDH 4. Below is my command. sqoop export -D sqoop.export.records.oer.statement=1 --fields-terminated-by ' '  --driver com.ddtek.jdbc.oracle.OracleDriver --connect "jdbc:datadirect:oracle:@:1521;databaseName=ORCL"  --username HR --password hr1 --table WORDDS --export-dir But i can not complete
Hi All, I want to import a picture from db2 to hdfs via sqoop with following steps. 1. Save one picture into db2. 2. Import the picture into hdfs from db2 via sqoop 3. Import the picture from hdfs into db2 again. 4. Here are my questions: 1. could sqoop support this scenario? 2. is there data format transformation during these imports? Could you please give your
Hi, I am looking for 1. Best practices 2. Do's and don'ts 3. Problem faced during importing/exporting data from RDBMS to HDFS using sqoop and their solution if known. Thanks Krish
Hi, I hope I have got this one right. Basically shows steps in importing an RDBMS table into HDFS via Sqopp and Hadoop. Please have a look and suggest any errors and improvements etc. Regards, Mich Talebzadeh http://talebzadehmich.wordpress.com Publications due shortly: Creating in-memory Data Grid for Trading Systems with Oracle TimesTen and Coherence
Hi All, i have data in my file in HDFS like below; "1","ABC","this is good,i like it" Delimiter is "," and i am loading this data in oracle.Is there a way to have this data correctly loaded in oracle tables. I checked the sqoop help and found this- Can someone please help me if i am using the right argument to load the data in oracle Regards, Archana
Hi, I wonder whether it is possible to import data from Hadoop HDFS directly to MongoDB?  Now I copy the data from HDFS to local drives, then import.  When the data is huge it is a waste of time. If import HDFS is possible that would be great. Thanks! Shi