HUE-6659 [import] Support RDBMs as input via Sqoop

Review Request #10896 - Created June 8, 2017 and updated - Latest diff uploaded

Information
Prachi Poddar
hue
HUE-6659
91837de...
Reviewers
romain

dhcp-172-16-2-143:hue prachi.poddar$ git whatchanged -15
commit 687c4aba9e52131efa99437adf4898182cced1ee
Author: Prachi Poddar prachi.poddar@cloudera.com
Date: Mon Jul 24 11:51:27 2017 -0700

HUE-6659 [import] Cleaned code based on the code review. Added rdbms.py. Replaced test connection checkbox with button

:100644 100644 4c059b36f5... 2dfea9c063... M apps/oozie/src/oozie/templates/editor2/gen/workflow-sqoop.xml.mako
:100644 100644 d4b63c8bb3... 23e530c1b4... M desktop/conf.dist/hue.ini
:100644 100644 08ddda3733... a8b56959cc... M desktop/conf/pseudo-distributed.ini.tmpl
:100644 100644 f076329ddd... d7b99b4941... M desktop/libs/indexer/src/indexer/api3.py
:000000 100644 0000000000... 17eac54ad1... A desktop/libs/indexer/src/indexer/indexers/rdbms.py
:100644 000000 e574059ff2... 0000000000... D desktop/libs/indexer/src/indexer/rdbms_indexer.py
:100644 100644 bec0acca4e... 4c0f04d415... M desktop/libs/indexer/src/indexer/rdbms_indexer_tests.py
:100644 100644 5daa6bffe0... 4a04d93367... M desktop/libs/indexer/src/indexer/templates/importer.mako
:100644 100644 aa9ff75739... ca8e4a1f7c... M desktop/libs/indexer/src/indexer/urls.py
:100644 100644 644044d263... e08129aa66... M desktop/libs/librdbms/src/librdbms/server/oracle_lib.py

commit 255a42cf62d280bae744cc352552283abaefe3e4
Author: Prachi Poddar prachi.poddar@cloudera.com
Date: Sun Jul 16 23:11:36 2017 -0700

HUE-6659 [import] added hive as a new option in Rdbms data import.

:100644 100644 758e2fde9d... f076329ddd... M desktop/libs/indexer/src/indexer/api3.py
:100644 100644 30c18f7e15... 5daa6bffe0... M desktop/libs/indexer/src/indexer/templates/importer.mako
:100644 100644 c51bf27be5... aa9ff75739... M desktop/libs/indexer/src/indexer/urls.py

commit 8e12fb18274b5d02ced7ea6cdb0b75e1fa4e6b3a
Author: Prachi Poddar prachi.poddar@cloudera.com
Date: Wed Jul 12 13:04:08 2017 -0700

HUE-6659 [import] added test connection front-end for custom db and output options for external databases

:100644 100644 2625651265... 758e2fde9d... M desktop/libs/indexer/src/indexer/api3.py
:100644 100644 5cb2bc75f9... bec0acca4e... M desktop/libs/indexer/src/indexer/rdbms_indexer_tests.py
:100644 100644 ad8c316c60... 30c18f7e15... M desktop/libs/indexer/src/indexer/templates/importer.mako
:100644 100644 ee3f36f76e... c51bf27be5... M desktop/libs/indexer/src/indexer/urls.py

commit 55bffb4c3540e1bcea59395e0b30542c0a56a04f
Author: Prachi Poddar prachi.poddar@cloudera.com
Date: Tue Jul 11 15:49:38 2017 -0700

HUE-6659 [importer] Database name and Table name dropdown populated successfully for config mode

:100644 100644 7101159479... 2625651265... M desktop/libs/indexer/src/indexer/api3.py
:100644 100644 a5b79ba3f5... 5cb2bc75f9... M desktop/libs/indexer/src/indexer/rdbms_indexer_tests.py
:100644 100644 f424eaea54... ad8c316c60... M desktop/libs/indexer/src/indexer/templates/importer.mako

commit 5564220755d2e4aef5b1758df617dee2889eb95d
Author: Prachi Poddar prachi.poddar@cloudera.com
Date: Sat Jun 24 19:53:10 2017 -0700

HUE-6659 [import] added custom and config database options

:100644 100644 d87bbc5a66... 7101159479... M desktop/libs/indexer/src/indexer/api3.py
:100644 100644 d84e48f9f1... e574059ff2... M desktop/libs/indexer/src/indexer/rdbms_indexer.py
:100644 100644 85a4e33f3f... a5b79ba3f5... M desktop/libs/indexer/src/indexer/rdbms_indexer_tests.py
:100644 100644 e93c132366... f424eaea54... M desktop/libs/indexer/src/indexer/templates/importer.mako
:100644 100644 1bc826c81d... ee3f36f76e... M desktop/libs/indexer/src/indexer/urls.py

commit c4958756defa8e1fc74932f201a3aeb836e8c97b
Author: Romain Rigaux romain@cloudera.com
Date: Fri Jun 23 15:30:58 2017 -0700

HUE-6659 [importer] Quick clean-up to submit sqoop as a task

:100644 100644 d30edd9c20... d87bbc5a66... M desktop/libs/indexer/src/indexer/api3.py
:100644 100644 760c3c26e4... e93c132366... M desktop/libs/indexer/src/indexer/templates/importer.mako

commit 9aefe252ed09a7a9d2672ef2449313604b3b5e1f
Author: Prachi Poddar prachi.poddar@cloudera.com
Date: Sun Jun 11 19:13:24 2017 -0700

HUE-6659 [import] Support RDBMs as input via Sqoop

:100644 100644 ae6c2de88d... a9b53ed326... M apps/oozie/src/oozie/models2.py
:100644 100644 ccb4242c9c... d30edd9c20... M desktop/libs/indexer/src/indexer/api3.py
:100644 100644 ec0f517cff... a4036bcef9... M desktop/libs/indexer/src/indexer/conf.py
:000000 100644 0000000000... d84e48f9f1... A desktop/libs/indexer/src/indexer/rdbms_indexer.py
:000000 100644 0000000000... 85a4e33f3f... A desktop/libs/indexer/src/indexer/rdbms_indexer_tests.py
:100644 100644 11b9ecedef... 760c3c26e4... M desktop/libs/indexer/src/indexer/templates/importer.mako
:100644 100644 76722d8b30... 02ef9f522a... M desktop/libs/notebook/src/notebook/connectors/base.py

commit a3ff7af21da91b035f927ba531849f5371af1224
Author: Romain Rigaux romain@cloudera.com
Date: Fri Jul 28 11:12:05 2017 -0700

HUE-5217 [backend] Resolve LGPL copyleft issue - Paramiko in boto 2.46.1

:100644 000000 1eb9db47d5... 0000000000... D desktop/core/ext-py/boto-2.46.1/boto/mashups/interactive.py

commit 7b15b90eb3d61249e03731dccd702cdfb2525cb4
Author: Romain Rigaux romain@cloudera.com
Date: Thu Jul 27 17:26:49 2017 -0700

HUE-6968 [metadata] Gather column stats via Impala

:100644 100644 e3a936c3b3... 139469a596... M apps/beeswax/src/beeswax/server/dbms.py
:100644 100644 d34b433770... 66089ead57... M desktop/libs/metadata/src/metadata/optimizer_api.py

commit 9b715711e290702233c08a0afdcb0e77c21cd518
Author: Romain Rigaux romain@cloudera.com
Date: Thu Jul 27 15:41:11 2017 -0700

HUE-6968 [metadata] Gather table stats via Impala

:100644 100644 82eb8aa1b6... 6a8a9bddd1... M apps/beeswax/src/beeswax/views.py
:100644 100644 75e098622e... d34b433770... M desktop/libs/metadata/src/metadata/optimizer_api.py

commit d4f453f6664256c56444303eb47c54597ba1e2ad
Author: Romain Rigaux romain@cloudera.com
Date: Thu Jul 27 14:53:20 2017 -0700

HUE-6954 [indexer] Support different number of shards, replication at index creation

:100644 100644 ac39c6272e... ccb4242c9c... M desktop/libs/indexer/src/indexer/api3.py
:100644 100644 9779cfdccd... 5324a07482... M desktop/libs/indexer/src/indexer/solr_client.py
:100644 100644 2587fe9742... 11b9ecedef... M desktop/libs/indexer/src/indexer/templates/importer.mako

commit ff6fe4e70ecc99283adb94175f6dce114a711c76
Author: Romain Rigaux romain@cloudera.com
Date: Thu Jul 27 14:46:55 2017 -0700

HUE-6974 [importer] Refresh Assist collection list after create table wizard success

When not using the batch indexer, we submit synchronously so we now it was created.

:100644 100644 4269d8bdc0... ac39c6272e... M desktop/libs/indexer/src/indexer/api3.py
:100644 100644 0947ee1f24... 2587fe9742... M desktop/libs/indexer/src/indexer/templates/importer.mako

commit e273d3347ad97cd4ed9084c21d9fa9c90a314573
Author: Romain Rigaux romain@cloudera.com
Date: Thu Jul 27 14:38:43 2017 -0700

HUE-6973 [indexer] Open up the index page after creating a new index

:100644 100644 8ce1dce1bf... 4269d8bdc0... M desktop/libs/indexer/src/indexer/api3.py
:100644 100644 1ca429779b... 1bc826c81d... M desktop/libs/indexer/src/indexer/urls.py

commit 048b7b944d15cc0e3af094a3561379ceac3abf9f
Author: Romain Rigaux romain@cloudera.com
Date: Thu Jul 27 14:24:22 2017 -0700

HUE-6972 [metadata] Sometimes the DB owner is shown as ()

:100644 100644 272a1991ad... 0f3f469181... M apps/metastore/src/metastore/templates/metastore.mako

commit ac41d006e5d1b7f8b12f6b8907430b8a976ec626
Author: Romain Rigaux romain@cloudera.com
Date: Thu Jul 27 14:07:07 2017 -0700

HUE-6971 [jb] Schedule list is filtered by default on 7 days which hides most of them

:100644 100644 56d84589b8... 27547054e9... M apps/jobbrowser/src/jobbrowser/apis/schedule_api.py
:100644 100644 cc1e79017a... 2cf28fa571... M apps/jobbrowser/src/jobbrowser/templates/job_browser.mako

Yes. Working fine

Loading...