HUE-8591 [cluster] Enable submission to kubernetes clusters

Review Request #13394 - Created Sept. 25, 2018 and submitted

Romain Rigaux
hue
master
HUE-8591
hue
commit ce4a688ebe9ccc5c24249f8c150ab2c0dd5e14bb
Author: Romain Rigaux <romain@cloudera.com>
Date:   Tue Sep 25 20:33:28 2018 -0700

    HUE-8591 [cluster] Remove extra debug info

:100644 100644 26da741... ee518a8... M	apps/beeswax/src/beeswax/server/dbms.py
:100644 100644 4687093... 369c068... M	apps/beeswax/src/beeswax/server/hive_server2_lib.py
:100644 100644 6729a9f... d245138... M	apps/impala/src/impala/conf.py
:100644 100644 d584874... f658100... M	apps/jobbrowser/src/jobbrowser/templates/job_browser.mako
:100644 100644 067acb0... e57f273... M	desktop/core/src/desktop/templates/assist.mako
:100644 100644 1469359... 70bb11d... M	desktop/core/src/desktop/templates/ko_components/ko_multi_cluster_sidebar.mako

commit f0035a57ad8a95b5f5c3ff7419aff7fea1ba4351
Author: Romain Rigaux <romain@cloudera.com>
Date:   Tue Sep 25 08:51:13 2018 -0700

    HUE-8591 [impala] Properly point to the selected cluster hostname

:100644 100644 a41f90c... 26da741... M	apps/beeswax/src/beeswax/server/dbms.py
:100644 100644 2f8af4a... 44991d4... M	desktop/core/src/desktop/api2.py
:100644 100644 4bcb215... 8f6e12a... M	desktop/core/src/desktop/static/desktop/js/apiHelper.js
:100644 100644 1e46b27... afa1af1... M	desktop/libs/notebook/src/notebook/connectors/base.py

commit a976f7838c95163c348b3f11a6abcd43e229b796
Author: Romain Rigaux <romain@cloudera.com>
Date:   Tue Sep 25 08:41:50 2018 -0700

    HUE-8591 [impala] Properly pickup the selected compute cluster

:100644 100644 785696b... be34c5e... M	desktop/libs/notebook/src/notebook/connectors/hiveserver2.py

commit 64b68146765b89e4633021507cef7b0a363486fa
Author: Romain Rigaux <romain@cloudera.com>
Date:   Fri Sep 21 18:10:02 2018 -0700

    HUE-8591 [cluster] Step of logic simplification of the multi cluster configuration

:100644 100644 f6b71a3... d584874... M	apps/jobbrowser/src/jobbrowser/templates/job_browser.mako
:100644 100644 68b72b2... 2f8af4a... M	desktop/core/src/desktop/api2.py
:100644 100644 ef00a7a... b220d09... M	desktop/core/src/desktop/conf.py
:100644 100644 95dcee5... 33394e8... M	desktop/core/src/desktop/models.py
:100644 100644 bf5032c... 1efa0b3... M	desktop/libs/notebook/src/notebook/connectors/altus.py

commit bb5ee5db598c2defc32935b6ca31314b56b28d79
Author: Romain Rigaux <romain@cloudera.com>
Date:   Fri Sep 21 13:51:08 2018 -0700

    HUE-8591 [cluster] Avoid failing when cluster is None

:100644 100644 8b695f1... a41f90c... M	apps/beeswax/src/beeswax/server/dbms.py

commit 6c1e9ea0069604e41c0bdcffe1e5306169e007d7
Author: Romain Rigaux <romain@cloudera.com>
Date:   Fri Sep 21 13:43:38 2018 -0700

    HUE-8591 [cluster] Add Thrift client used for the specific query server

:100644 100644 ce54d81... 4687093... M	apps/beeswax/src/beeswax/server/hive_server2_lib.py

commit 4bc942ba0614fada1b307261c4ae2f24812cef89
Author: Romain Rigaux <romain@cloudera.com>
Date:   Fri Sep 21 13:42:03 2018 -0700

    HUE-8591 [cluster] Use properly Impala Thrift Client on remote Impala cluster direct connection

:100644 100644 e78c1b2... 8b695f1... M	apps/beeswax/src/beeswax/server/dbms.py
:100644 100644 5e49b6e... ce54d81... M	apps/beeswax/src/beeswax/server/hive_server2_lib.py

commit 83ae2a91d04c7afd9f70b2e054b84851c101519e
Author: Romain Rigaux <romain@cloudera.com>
Date:   Fri Sep 21 13:13:01 2018 -0700

    HUE-8339 [impala] Fix typo in smart pooling ini configuration

:100644 100644 5c56c02... 1589d2f... M	desktop/conf.dist/hue.ini
:100644 100644 a6bb0fb... 3ce0b3e... M	desktop/conf/pseudo-distributed.ini.tmpl

commit 68ae178c25cab51d327b747b56ffa1d4f4c2dcee
Author: Romain Rigaux <romain@cloudera.com>
Date:   Fri Sep 21 11:13:30 2018 -0700

    HUE-8591 [cluster] Prevent red error popups

:100644 100644 f72737b... e78c1b2... M	apps/beeswax/src/beeswax/server/dbms.py
:100644 100644 7bbbfca... 5e49b6e... M	apps/beeswax/src/beeswax/server/hive_server2_lib.py
:100644 100644 fcd795d... 6729a9f... M	apps/impala/src/impala/conf.py
:100644 100644 e8562d5... 82b3c59... M	apps/impala/src/impala/server.py
:100644 100644 9f305af... d655884... M	apps/jobbrowser/src/jobbrowser/apis/data_warehouse.py

commit b426bdee479b47765e730bcaa8f7f526a5f97226
Author: Romain Rigaux <romain@cloudera.com>
Date:   Fri Sep 21 09:14:10 2018 -0700

    HUE-8591 [cluster] Add impalad link to cluster page

:100644 100644 0da58f3... f6b71a3... M	apps/jobbrowser/src/jobbrowser/templates/job_browser.mako

commit 07b6697ec7f2ecec3683116f1d0a247f5ca98faa
Author: Romain Rigaux <romain@cloudera.com>
Date:   Fri Sep 21 09:00:31 2018 -0700

    HUE-8591 [cluster] Add some progress bar color and effect on cluster resize

:100644 100644 048939f... 0da58f3... M	apps/jobbrowser/src/jobbrowser/templates/job_browser.mako

commit e28d0b6b6d29b83d26a0b94a11b3976887ff35c3
Author: Romain Rigaux <romain@cloudera.com>
Date:   Fri Sep 21 08:05:29 2018 -0700

    HUE-8591 [cluster] Split cluster template between static and dynamic clusters

:100644 100644 03bbaba... 9f305af... M	apps/jobbrowser/src/jobbrowser/apis/data_warehouse.py
:100644 100644 1501d4a... 048939f... M	apps/jobbrowser/src/jobbrowser/templates/job_browser.mako

commit 818bae5d388268a64eee4e14980f6c165673693c
Author: Romain Rigaux <romain@cloudera.com>
Date:   Fri Sep 21 07:44:49 2018 -0700

    HUE-8591 [cluster] Add hostname check in the cluster hostname log trace

:100644 100644 e3a6731... f72737b... M	apps/beeswax/src/beeswax/server/dbms.py

commit e548ebec021ecb87fd3f49264c26e3a39c40be6d
Author: Romain Rigaux <romain@cloudera.com>
Date:   Fri Sep 21 07:26:03 2018 -0700

    HUE-8591 [cluster] Protect against override of cluster name

:100644 100644 1203ea9... e3a6731... M	apps/beeswax/src/beeswax/server/dbms.py

commit c674e72ca1cce5d6045a601ee2175c2ed182e218
Author: Romain Rigaux <romain@cloudera.com>
Date:   Thu Sep 20 23:41:10 2018 -0700

    HUE-8591 [cluster] Move port to 21050

:100644 100644 ac791d4... bbc1417... M	apps/impala/src/impala/dbms.py

commit f988fd764f19fff6249631af5179e8d62b842771
Author: Romain Rigaux <romain@cloudera.com>
Date:   Thu Sep 20 23:17:10 2018 -0700

    HUE-8591 [cluster] Use default port if ont in a selected remote cluster

:100644 100644 1079406... 1203ea9... M	apps/beeswax/src/beeswax/server/dbms.py
:100644 100644 5b02ca3... ac791d4... M	apps/impala/src/impala/dbms.py
:100644 100644 45f5f78... 68b72b2... M	desktop/core/src/desktop/api2.py

commit 295dddfbd39efd4cb12a3e5141666915e56a6533
Author: Johan Ahlen <johan@johanahlen.com>
Date:   Fri Sep 21 07:48:31 2018 +0200

    HUE-8591 [cluster] Clear the compute cache on namespace refresh from left assist

:100644 100644 0afb825... e5a8343... M	desktop/core/src/desktop/static/desktop/js/assist/assistDbSource.js
:100644 100644 3f0ab51... cc0c9e3... M	desktop/core/src/desktop/static/desktop/js/contextCatalog.js
:100644 100644 e03be13... cef3405... M	desktop/core/src/desktop/templates/ko_components/ko_context_selector.mako

commit 74bf32d69154bfbe0a9f3843f7847a3b70a7adb6
Author: Johan Ahlen <johan@johanahlen.com>
Date:   Fri Sep 21 07:27:03 2018 +0200

    HUE-8591 [cluster] Refresh the context selector when namespaces are refreshed

:100644 100644 4385bb0... e03be13... M	desktop/core/src/desktop/templates/ko_components/ko_context_selector.mako

commit 5b6fc371de9929a2356076b127486dfdd71513fc
Author: Romain Rigaux <romain@cloudera.com>
Date:   Thu Sep 20 22:06:37 2018 -0700

    HUE-8591 [cluster] Fix name of default cluster

:100644 100644 2c27d04... 1079406... M	apps/beeswax/src/beeswax/server/dbms.py

commit f7c1f75235c97884cea3222651056202d761c642
Author: Romain Rigaux <romain@cloudera.com>
Date:   Thu Sep 20 20:48:05 2018 -0700

    HUE-8591 [cluster] Safeguard against localhost

:100644 100644 20bdbda... 2c27d04... M	apps/beeswax/src/beeswax/server/dbms.py
:100644 100644 dab6f7e... 1501d4a... M	apps/jobbrowser/src/jobbrowser/templates/job_browser.mako

commit 313b63971354e9e0a28bd4280955cae1e02ae009
Author: Romain Rigaux <romain@cloudera.com>
Date:   Thu Sep 20 19:51:06 2018 -0700

    HUE-8591 [cluster] Use name as clusterName throughout the calls

:100644 100644 7dd0635... 20bdbda... M	apps/beeswax/src/beeswax/server/dbms.py
:100644 100644 0160399... bf5032c... M	desktop/libs/notebook/src/notebook/connectors/altus.py

commit 6e7c161da942821a8092030ea3e3d614ca56192a
Author: Romain Rigaux <romain@cloudera.com>
Date:   Thu Sep 20 19:46:35 2018 -0700

    HUE-8591 [cluster] Properly use the correct cluster hostname in the editor

:100644 100644 417f091... 7dd0635... M	apps/beeswax/src/beeswax/server/dbms.py
:100644 100644 a76d4a6... dab6f7e... M	apps/jobbrowser/src/jobbrowser/templates/job_browser.mako
:100644 100644 fd83de3... 1e46b27... M	desktop/libs/notebook/src/notebook/connectors/base.py
:100644 100644 cb321dd... 785696b... M	desktop/libs/notebook/src/notebook/connectors/hiveserver2.py

commit 9c525092d8ea6067942497c540b3efe116de26e2
Author: Romain Rigaux <romain@cloudera.com>
Date:   Thu Sep 20 19:32:49 2018 -0700

    HUE-8591 [cluster] Display impalad hostname

:100644 100644 4c11000... a76d4a6... M	apps/jobbrowser/src/jobbrowser/templates/job_browser.mako
:100644 100644 08766d6... 0160399... M	desktop/libs/notebook/src/notebook/connectors/altus.py

commit 480f4923f50b5e34f8aaf7766ed5f9a9841d7be8
Author: Romain Rigaux <romain@cloudera.com>
Date:   Thu Sep 20 18:59:30 2018 -0700

    HUE-8591 [cluster] Add logic to get the corresponding Impalad name

:100644 100644 02d468a... 417f091... M	apps/beeswax/src/beeswax/server/dbms.py
:100644 100644 782ffce... 45f5f78... M	desktop/core/src/desktop/api2.py

commit f464943e864dd215a8176f805f53fdcd57bd9ffc
Author: Romain Rigaux <romain@cloudera.com>
Date:   Thu Sep 20 13:20:32 2018 -0700

    HUE-8591 [cluster] Hook in remote Impala coordinator URL of selected cluster

:100644 100644 175f18e... 02d468a... M	apps/beeswax/src/beeswax/server/dbms.py
:100644 100644 ca0b184... 5b02ca3... M	apps/impala/src/impala/dbms.py
:100644 100644 d8e1a05... 782ffce... M	desktop/core/src/desktop/api2.py
:100644 100644 adc40cb... ef00a7a... M	desktop/core/src/desktop/conf.py
:100644 100644 f9b713a... fd83de3... M	desktop/libs/notebook/src/notebook/connectors/base.py

commit 10548081ad7a2774f3c3771bbd2c775dbd9069bf
Author: Romain Rigaux <romain@cloudera.com>
Date:   Thu Sep 20 12:42:27 2018 -0700

    HUE-8591 [cluster] Adding cluster resize capabilities on the cluster page

:100644 100644 d971269... 4c11000... M	apps/jobbrowser/src/jobbrowser/templates/job_browser.mako
:100644 100644 b730355... 6c5e512... M	desktop/libs/metadata/src/metadata/analytic_db_api.py
:100644 100644 1da7ce3... faa7426... M	desktop/libs/metadata/src/metadata/urls.py
:100644 100644 8cba8c0... 08766d6... M	desktop/libs/notebook/src/notebook/connectors/altus.py

commit 9bdc93d675ef4ef1a0fb152810ade009efd83cc4
Author: Romain Rigaux <romain@cloudera.com>
Date:   Thu Sep 20 11:32:26 2018 -0700

    HUE-8591 [cluster] Wire in API for listing and creating k8 clusters

:100644 100644 acd63e9... 03bbaba... M	apps/jobbrowser/src/jobbrowser/apis/data_warehouse.py
:100644 100644 788e067... d971269... M	apps/jobbrowser/src/jobbrowser/templates/job_browser.mako
:100644 100644 ed3f413... b730355... M	desktop/libs/metadata/src/metadata/analytic_db_api.py
:100644 100644 17d6e6b... 8cba8c0... M	desktop/libs/notebook/src/notebook/connectors/altus.py

commit 76a20547e6b33ede56e38f2d6af7ceafa168df13
Author: Romain Rigaux <romain@cloudera.com>
Date:   Thu Sep 20 08:46:30 2018 -0700

    HUE-8591 [cluster] Move API url to a config property

:100644 100644 9d96016... 67c48ab... M	desktop/libs/metadata/src/metadata/conf.py
:100644 100644 d4c59e6... 17d6e6b... M	desktop/libs/notebook/src/notebook/connectors/altus.py

commit 150d4f7ce75314ab479c7e3932eeb0b4174a040f
Author: Romain Rigaux <romain@cloudera.com>
Date:   Wed Sep 19 15:36:35 2018 -0700

    HUE-8591 [cluster] Plug in the list of clusters

:100644 100644 47ddbac... acd63e9... M	apps/jobbrowser/src/jobbrowser/apis/data_warehouse.py
:100644 100644 daae1bb... d4c59e6... M	desktop/libs/notebook/src/notebook/connectors/altus.py

commit ffeeab00ea000edb2bea9112a0459fa9f38bb905
Author: Romain Rigaux <romain@cloudera.com>
Date:   Wed Sep 19 15:08:36 2018 -0700

    HUE-8591 [cluster] Add proper cluster page

:100644 100644 c56bfc1... 47ddbac... M	apps/jobbrowser/src/jobbrowser/apis/data_warehouse.py
:100644 100644 e5f9d7f... 788e067... M	apps/jobbrowser/src/jobbrowser/templates/job_browser.mako

commit 91e5281e0d5b0fcd77f0da52f9c42817eae393df
Author: Romain Rigaux <romain@cloudera.com>
Date:   Wed Sep 19 13:35:10 2018 -0700

    HUE-8591 [cluster] Integration skeleton for Data Warehouse v2 API

:100644 100644 cb930aa... ff6dcad... M	apps/jobbrowser/src/jobbrowser/apis/base_api.py
:100644 100644 c5d831d... c56bfc1... M	apps/jobbrowser/src/jobbrowser/apis/data_warehouse.py
:100644 100644 0a420a9... e5f9d7f... M	apps/jobbrowser/src/jobbrowser/templates/job_browser.mako
:100644 100644 325da40... d8e1a05... M	desktop/core/src/desktop/api2.py
:100644 100644 e57f273... 067acb0... M	desktop/core/src/desktop/templates/assist.mako
:100644 100644 948b936... 1469359... M	desktop/core/src/desktop/templates/ko_components/ko_multi_cluster_sidebar.mako
:100644 100644 7643e8f... daae1bb... M	desktop/libs/notebook/src/notebook/connectors/altus.py

commit 7e104be65a576dbffed39c0f90dd96beadb5d71d
Author: Romain Rigaux <romain@cloudera.com>
Date:   Wed Sep 19 13:27:34 2018 -0700

    HUE-8591 [core] Showing up S3 browser by default in cloud mode

:100644 100644 690fc09... 95dcee5... M	desktop/core/src/desktop/models.py

manual

more clean-up on the way

  • 4
  • 0
  • 0
  • 0
  • 4
Description From Last Updated
Nit: red... Johan Åhlén
$root.compute() has changed to $root.cluster() Johan Åhlén
Same. Johan Åhlén
debug output Johan Åhlén
  1. Ship It!
  2. apps/impala/src/impala/conf.py (Diff revision 1)
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     

    Nit: red...

  3. apps/jobbrowser/src/jobbrowser/templates/job_browser.mako (Diff revision 1)
     
     
     
     
     
     
     
     
     
     

    $root.compute() has changed to $root.cluster()

    1. Yes, had not rebased on master yet

  4. 
      
Review request changed

Status: Closed (submitted)

Loading...