HUE-8758 [connectors] Configuration via connectors part 3/3

Review Request #14730 — Created Jan. 31, 2020 and submitted

romain
hue
master
HUE-8758
hue
johan, ranade, romain, weixia, yingc
commit 0edb98b98f5a36fbe81605004b018dbc01745a8e
Author: Romain <romain.rigaux@gmail.com>
Date:   Fri Jan 31 10:55:01 2020 -0800

    HUE-8758 [connector] Fixes post rebase

:100644 100644 0ff9d724b1 0ec1b84edf M	apps/useradmin/src/useradmin/api.py

commit 96bd275e433460cb34af15f5e1c9cc9dc87ea88a
Author: Romain <romain.rigaux@gmail.com>
Date:   Thu Jan 30 12:42:43 2020 -0800

    HUE-8758 [editor] Link to add connector page when no snippet configured and admin

:100644 100644 7caa05f14c 014daf200d M	apps/about/src/about/templates/admin_wizard.mako
:100644 100644 e5b62e6615 b4d75cfba0 M	desktop/libs/notebook/src/notebook/templates/notebook.mako

commit 40813809953f66e8b3e239b721c929719b8d52ee
Author: Romain <romain.rigaux@gmail.com>
Date:   Thu Jan 30 10:41:58 2020 -0800

    HUE-8530 [organization] Update migration scripts part 2
    
    Desktop as a dependency on Connectors

:000000 100644 0000000000 4848065153 A	apps/useradmin/src/useradmin/org_migrations/0002_auto_20200130_1041.py

commit 0906bc2af2174908e8a9191b91a5e9e756f57af0
Author: Romain <romain.rigaux@gmail.com>
Date:   Thu Jan 30 10:10:02 2020 -0800

    HUE-8530 [organization] Update migration scripts part 1
    
            Updated:
                  vim desktop/core/src/desktop/migrations/0001_initial.py
                  -->
                  bases=(models.Model, django_prometheus.models.ExportModelOperationsMixin('Document2')),
    
                Skipped for now:
                ./build/env/bin/hue makemigrations jobsub
                ./build/env/bin/hue makemigrations oozie
                ./build/env/bin/hue makemigrations pig
                ./build/env/bin/hue makemigrations search

:100644 000000 f44565141a 0000000000 D	apps/beeswax/src/beeswax/org_migrations/0001_initial.py
:100644 000000 e69de29bb2 0000000000 D	apps/beeswax/src/beeswax/org_migrations/__init__.py
:100644 100644 f043f46a15 7fc28c0311 M	apps/useradmin/src/useradmin/org_migrations/0001_initial.py
:100644 100644 d0f0a49b84 9a76cd04d8 M	desktop/core/src/desktop/org_migrations/0001_initial.py

commit e28c903bb6327ec2ee98dfd9947dc7ee28e935f3
Author: Romain <romain.rigaux@gmail.com>
Date:   Thu Jan 30 09:58:34 2020 -0800

    HUE-8530 [organization] Consolidate all the logic into the organization module

:100644 100644 b3046410d2 e0b24b9bb6 M	apps/useradmin/src/useradmin/models.py
:100644 100644 3f34820b74 f7ec7a091c M	apps/useradmin/src/useradmin/organization.py
:100644 100644 a8f17af940 a8f17af940 R100	apps/useradmin/src/useradmin/models2_tests.py	apps/useradmin/src/useradmin/organization_tests.py
:100644 100644 999f18c335 6e2fc8367c M	apps/useradmin/src/useradmin/permissions.py
:100644 100644 c96dfdb6a3 ceb4d10230 M	apps/useradmin/src/useradmin/views.py

commit 58792e4a78fa98f0964a4f97fb05f98ce8c5f9ad
Author: Romain <romain.rigaux@gmail.com>
Date:   Wed Jan 29 11:48:21 2020 -0800

    HUE-8758 [connector] Install examples for the particular connector

:100644 100644 4f55b99e60 7caa05f14c M	apps/about/src/about/templates/admin_wizard.mako
:100644 100644 5048fe1671 9bbc9b2fc0 M	apps/beeswax/src/beeswax/management/commands/beeswax_install_examples.py
:100644 100644 1fa7a85137 84a97db2da M	apps/beeswax/src/beeswax/server/dbms.py
:100644 100644 cdd672afc2 52adb71191 M	apps/beeswax/src/beeswax/views.py
:100644 100644 8d8e852f93 b3046410d2 M	apps/useradmin/src/useradmin/models.py
:100644 100644 13694f825a fdec651902 M	desktop/core/src/desktop/lib/connectors/models.py
:100644 100644 c5f873c652 f997abfbd4 M	desktop/core/src/desktop/models.py
:100644 100644 9a157e3d93 c289e0f866 M	desktop/libs/notebook/src/notebook/api.py
:100644 100644 bc138ecbc1 e6b75de9f2 M	desktop/libs/notebook/src/notebook/models.py
:100644 100644 56a3a1c2f9 450872c472 M	desktop/libs/notebook/src/notebook/views.py

commit dcbc99d86cb89e4e257717888f8dd0269972086d
Author: Romain <romain.rigaux@gmail.com>
Date:   Wed Jan 29 10:42:02 2020 -0800

    HUE-8758 [connector] API to install data examples

:100644 100644 5a7d268626 4f55b99e60 M	apps/about/src/about/templates/admin_wizard.mako
:100644 100644 1eb9f80722 5048fe1671 M	apps/beeswax/src/beeswax/management/commands/beeswax_install_examples.py
:100644 100644 1d412e5e47 8d8e852f93 M	apps/useradmin/src/useradmin/models.py
:100644 100644 98ea4b703a 2dfc7ac99c M	desktop/libs/hadoop/src/hadoop/cluster.py
:100644 100644 e76c2913c2 56a3a1c2f9 M	desktop/libs/notebook/src/notebook/views.py

commit 1e81516afee4bf13f80cb15ca31a3258e31780b2
Author: Romain <romain.rigaux@gmail.com>
Date:   Wed Jan 29 09:16:35 2020 -0800

    HUE-8758 [connector] Port the Hive table sample install to kojs

:100644 100644 ab34741431 5a7d268626 M	apps/about/src/about/templates/admin_wizard.mako

commit 907a70b1e857055b509325244ed3ff2e1229a4fd
Author: Romain <romain.rigaux@gmail.com>
Date:   Wed Jan 29 07:44:01 2020 -0800

    HUE-8758 [connectors] Allow organization admin to install connector examples
    
    Also refresh the connector counts dynamically post install.

:100644 100644 7dfeadf0a6 ab34741431 M	apps/about/src/about/templates/admin_wizard.mako
:100644 100644 da59eb6bc4 00d9b64919 M	desktop/core/src/desktop/decorators.py
:100644 100644 8a3bbd15f7 8350277bfd M	desktop/core/src/desktop/lib/connectors/api.py

commit 72987e3c266588a3a43ebdbb78daa5c41ce7b41b
Author: Romain <romain.rigaux@gmail.com>
Date:   Tue Jan 28 19:28:47 2020 -0800

    HUE-8758 [connector] API to install connector examples

:100644 100644 d9653777b2 7dfeadf0a6 M	apps/about/src/about/templates/admin_wizard.mako
:100644 100644 1e2a81cc2a 8a3bbd15f7 M	desktop/core/src/desktop/lib/connectors/api.py
:100644 100644 e2b3c85c01 a735e54b4a M	desktop/core/src/desktop/lib/connectors/urls.py

commit 766cb257f17d1e552e678c65cc018c7932eaf795
Author: Romain <romain.rigaux@gmail.com>
Date:   Tue Jan 28 13:43:45 2020 -0800

    HUE-8758 [connector] Auto install example connectors for the Hue admin

:100644 100644 a0712f8a6d d9653777b2 M	apps/about/src/about/templates/admin_wizard.mako
:100644 100644 2a1fbd4cb6 13694f825a M	desktop/core/src/desktop/lib/connectors/models.py
:100644 100644 fd229556d0 c5f873c652 M	desktop/core/src/desktop/models.py
:100644 100644 5dc38a7ec8 993cca4cf3 M	desktop/core/src/desktop/templates/connectors/connectors.mako

commit 1a66d52648b7a3a3fe13d696783bc101759064bd
Author: Romain <romain.rigaux@gmail.com>
Date:   Mon Jan 27 11:07:02 2020 -0600

    HUE-8530 [useradmin] Properly display the organization page

:100644 100644 84dc9f1404 9a3fc74f7b M	apps/useradmin/src/useradmin/templates/list_configurations.mako
:100644 100644 c90a20f0d5 75651feccd M	apps/useradmin/src/useradmin/templates/list_organizations.mako
:100644 100644 f5cde790bf c96dfdb6a3 M	apps/useradmin/src/useradmin/views.py
:100644 100644 6c790d6c43 b8a6679b97 M	desktop/core/src/desktop/templates/hue.mako

commit 22e6c786ee90f89ad713c6cdebbbb32f4dcc279b
Author: Romain <romain.rigaux@gmail.com>
Date:   Mon Jan 27 06:29:07 2020 -0600

    HUE-8530 [useradmin] Adding basic organization page

:100644 100644 4354d344c4 4abd4b1a7a M	apps/useradmin/src/useradmin/templates/layout.mako
:000000 100644 0000000000 c90a20f0d5 A	apps/useradmin/src/useradmin/templates/list_organizations.mako
:100644 100644 b23d1c3c6c f169951146 M	apps/useradmin/src/useradmin/urls.py
:100644 100644 9c147d8d3a f5cde790bf M	apps/useradmin/src/useradmin/views.py
:100644 100644 befabff1f1 e4020bfe0b M	desktop/core/src/desktop/js/onePageViewModel.js
:100644 100644 e4d82c3f6f 6c790d6c43 M	desktop/core/src/desktop/templates/hue.mako

commit c78c11ab47d77649497163c5bb7d3c4837741219
Author: Romain <romain.rigaux@gmail.com>
Date:   Sat Jan 18 14:12:33 2020 -0300

    HUE-8758 [auth] Fix some wrong styling indentation

:100644 100644 ee7e1ed696 a2d976bb40 M	desktop/core/src/desktop/auth/forms.py

commit 0ec34ae61398ec11bba0b5c82a23c91cf9cd4be5
Author: Romain <romain.rigaux@gmail.com>
Date:   Sat Jan 18 06:41:01 2020 -0600

    HUE-8758 [connector] Patching for combining query set filter

:100644 100644 fc94685514 9313d066a1 M	apps/useradmin/src/useradmin/models2.py
:100644 100644 2307613ddf a8f17af940 M	apps/useradmin/src/useradmin/models2_tests.py

commit 2665c4993d6005731500aff220855a2d739c4fbb
Author: Romain <romain.rigaux@gmail.com>
Date:   Sat Jan 18 06:40:33 2020 -0600

    HUE-9130 [useradmin] Deactivate user by default instead of deleting

:100644 100644 f7d864ce46 c55eb1e619 M	apps/useradmin/src/useradmin/templates/list_users.mako
:100644 100644 a132dc5ab5 9c147d8d3a M	apps/useradmin/src/useradmin/views.py

commit 4a89ac08049cc0408f07a43224e326efdfdcfbb1
Author: Romain <romain.rigaux@gmail.com>
Date:   Fri Jan 17 22:39:32 2020 -0600

    HUE-8758 [useradmin] Adding a test suite for is_admin

:100644 100644 ef3041bfbc 1a9bfbb554 M	apps/useradmin/src/useradmin/tests.py

commit 42d067c097109872da1861a695fc420be0880858
Author: Romain <romain.rigaux@gmail.com>
Date:   Fri Jan 17 22:05:09 2020 -0600

    HUE-9130 [useradmin] Harmonize add user icons

:100644 100644 29420e15ba f7d864ce46 M	apps/useradmin/src/useradmin/templates/list_users.mako

commit 1b8e2febd86614fdff8c4dff672de86991049698
Author: Romain <romain.rigaux@gmail.com>
Date:   Fri Jan 17 17:55:15 2020 -0600

    HUE-8530 [organization] Make ORM filter chaining backward compatible
    
    Can support username field in a values_list after the filter():
    e.g.
    
    User.objects.filter(groups__in=Group.objects.all()).values_list('username', flat=True)

:100644 100644 10a44314d7 fc94685514 M	apps/useradmin/src/useradmin/models2.py
:100644 100644 71afa845e7 2307613ddf M	apps/useradmin/src/useradmin/models2_tests.py

commit abf17282b24e5b234b0dd07fac5d863b7ea7aea9
Author: Romain <romain.rigaux@gmail.com>
Date:   Fri Jan 17 17:24:02 2020 -0600

    HUE-8530 [organization] Backward compatibility for User.objects.values_list

:100644 100644 9b35947525 10a44314d7 M	apps/useradmin/src/useradmin/models2.py
:100644 100644 861bbe7977 71afa845e7 M	apps/useradmin/src/useradmin/models2_tests.py

commit cadda151cc72ced2875f222bd7bca6ca986b9514
Author: Romain <romain.rigaux@gmail.com>
Date:   Fri Jan 17 14:35:55 2020 -0800

    HUE-9129 [useradmin] Add a is_admin column to the list user page

:100644 100644 f485aa918b 7cac947f82 M	apps/useradmin/src/useradmin/templates/list_groups.mako
:100644 100644 48d3ec1b15 29420e15ba M	apps/useradmin/src/useradmin/templates/list_users.mako

commit ecb27f8a1adc2c1a8c76b109f616b77341149691
Author: Romain <romain.rigaux@gmail.com>
Date:   Fri Jan 17 14:29:22 2020 -0800

    HUE-8530 [organization] Properly create new users in the current  organization

:100644 100644 485a49b111 13a293bea4 M	apps/useradmin/src/useradmin/forms.py
:100644 100644 29f5ef859e 179815fbb4 M	apps/useradmin/src/useradmin/templates/edit_user.mako

commit c803c27a3b03036e8d9495afebf25fa7920b1582
Author: Romain <romain.rigaux@gmail.com>
Date:   Fri Jan 17 14:12:12 2020 -0800

    HUE-8530 [organization] List organization name when editing users and groups

:100644 100644 72ed16c255 9b35947525 M	apps/useradmin/src/useradmin/models2.py
:100644 100644 70eec904fc bd66c770c0 M	apps/useradmin/src/useradmin/templates/edit_group.mako
:100644 100644 6cc23f8edd 8500e7b097 M	apps/useradmin/src/useradmin/templates/edit_permissions.mako
:100644 100644 b21d786a98 29f5ef859e M	apps/useradmin/src/useradmin/templates/edit_user.mako
:100644 100644 7dfb17d613 f485aa918b M	apps/useradmin/src/useradmin/templates/list_groups.mako
:100644 100644 7198db56a4 a4b09bb095 M	apps/useradmin/src/useradmin/templates/list_permissions.mako
:100644 100644 e9bb0da092 48d3ec1b15 M	apps/useradmin/src/useradmin/templates/list_users.mako

commit 9f673889321d736813b60f0851a3a4578d07b1bb
Author: Romain <romain.rigaux@gmail.com>
Date:   Fri Jan 17 13:50:43 2020 -0800

    HUE-8530 [organization] Only list the group of the user organization

:100644 100644 a193f48d1b 485a49b111 M	apps/useradmin/src/useradmin/forms.py
:100644 100644 2937540c58 4354d344c4 M	apps/useradmin/src/useradmin/templates/layout.mako
:100644 100644 2a9477553e a132dc5ab5 M	apps/useradmin/src/useradmin/views.py

commit 9c94ffc687fea49a403fa6b5c1df7670605e9a7e
Author: Romain <romain.rigaux@gmail.com>
Date:   Fri Jan 17 11:32:09 2020 -0800

    HUE-8758 [connectors] Hide ensure home directory creation input for now
    
    Only SQL connectors are currently supported

:100644 100644 b51dc9ae89 a193f48d1b M	apps/useradmin/src/useradmin/forms.py
:100644 100644 8b2663733b b21d786a98 M	apps/useradmin/src/useradmin/templates/edit_user.mako
:100644 100644 bcb0ab1d36 2a9477553e M	apps/useradmin/src/useradmin/views.py

commit f1723ea841c54c27e26f604f602c2cc7f2b580aa
Author: Romain <romain.rigaux@gmail.com>
Date:   Thu Jan 16 10:33:05 2020 -0800

    HUE-9129 [useradmin] Remove threading locks
    
    As not useful in distributed setup (multi Hues, task server...)
    and atomicity is enforced by the DB.

:100644 100644 688ff059a1 bcb0ab1d36 M	apps/useradmin/src/useradmin/views.py

commit e6aa53f4c2471c87d3fb30083b19f516ce748977
Author: Romain <romain.rigaux@gmail.com>
Date:   Thu Jan 16 09:41:32 2020 -0800

    HUE-8530 [organization] Unify permissions for the admin wizard

:100644 100644 7bf494f168 a0712f8a6d M	apps/about/src/about/templates/admin_wizard.mako
:100644 100644 3d57535c04 03b6fde634 M	apps/about/src/about/views.py
:100644 100644 70aa213ef0 f175feda0f M	desktop/core/src/desktop/templates/about_layout.mako
:100644 100644 a452332614 71ad6037cb M	desktop/core/src/desktop/templates/common_header.mako
:100644 100644 6c5b11cbd3 8509340d3c M	desktop/core/src/desktop/templates/dump_config.mako
:100644 100644 efa457df66 93ab8e3731 M	desktop/core/src/desktop/views.py

commit 362aa336085b5bf42528ccaa652ea4db2cda5663
Author: Romain <romain.rigaux@gmail.com>
Date:   Thu Jan 16 09:17:14 2020 -0800

    HUE-8530 [organization] Hide ini location when user not a Hue admin

:100644 100644 571f287b37 7bf494f168 M	apps/about/src/about/templates/admin_wizard.mako
:100644 100644 fbeaee3718 1ea8eb48f9 M	desktop/core/src/desktop/auth/backend.py
:100644 100644 d50adc78e1 59b17ee5f7 M	desktop/core/src/desktop/auth/decorators.py
:100644 100644 81951b7852 fdffb198ba M	desktop/core/src/desktop/auth/decorators_tests.py
:100644 100644 d2bf9acfae d901737de6 M	desktop/core/src/desktop/templates/check_config.mako

commit 458434d40e5b70c95e67176f8a59c98424689a37
Author: Romain <romain.rigaux@gmail.com>
Date:   Thu Jan 16 08:56:46 2020 -0800

    HUE-8530 [organization] Prepare split of is_admin and is_hue_admin

:100644 100644 1b128634ea 3d57535c04 M	apps/about/src/about/views.py
:100644 100644 a06808571f 72ed16c255 M	apps/useradmin/src/useradmin/models2.py
:100644 100644 99edf81314 fbeaee3718 M	desktop/core/src/desktop/auth/backend.py
:100644 100644 08c81c9ff5 8beabcb1dd M	desktop/core/src/desktop/js/ko/components/ko.sidebar.js
:100644 100644 1455f75544 70aa213ef0 M	desktop/core/src/desktop/templates/about_layout.mako
:100644 100644 aa592bb409 e30173c65d M	desktop/core/src/desktop/templates/global_js_constants.mako

commit 8923a69368bbc11f5cdd1fbe2c4ea1959a2ba491
Author: Romain <romain.rigaux@gmail.com>
Date:   Thu Jan 16 06:15:20 2020 -0800

    HUE-8758 [connector] Offer to safely blacklist the importer like a traditional app

:100644 100644 72878c9a14 fd229556d0 M	desktop/core/src/desktop/models.py

commit 607905f539521ab0986afe81ce87041fdd6e1091
Author: Romain <romain.rigaux@gmail.com>
Date:   Wed Jan 15 19:40:32 2020 -0800

    HUE-8530 [organization] Do not 403 when there is no snippet configured

:100644 100644 221599dc04 1d412e5e47 M	apps/useradmin/src/useradmin/models.py

commit e41b057d8b2cc8693bbf8b5cad99f1eb9551ae38
Author: Romain <romain.rigaux@gmail.com>
Date:   Wed Jan 15 14:36:07 2020 -0800

    HUE-8530 [organization] Try to log failed user login email if username is empty

:100644 100644 18dee5c8db e952e6bc96 M	desktop/core/src/desktop/auth/views.py

commit 78188a5876a33bc13255dee86776045c8b7e890d
Author: Romain <romain.rigaux@gmail.com>
Date:   Wed Jan 15 13:59:02 2020 -0800

    HUE-8758 [connector] Fill-up the connector FK of a Permission

:100644 100644 13f4ee1a11 571f287b37 M	apps/about/src/about/templates/admin_wizard.mako
:100644 100644 deb5e52243 221599dc04 M	apps/useradmin/src/useradmin/models.py
:100644 100644 5747623ee3 99edf81314 M	desktop/core/src/desktop/auth/backend.py
:100644 100644 7e9f6f71f3 2a1fbd4cb6 M	desktop/core/src/desktop/lib/connectors/models.py

commit 5911f851e83eeeabd20d0825a8b410c38c1989a7
Author: Romain <romain.rigaux@gmail.com>
Date:   Wed Jan 15 11:49:43 2020 -0800

    HUE-8530 [organization] Fix a series of bad imports

:100644 100644 4190b0de13 deb5e52243 M	apps/useradmin/src/useradmin/models.py
:100644 100644 3ce1b23a13 3ab966f175 M	desktop/core/src/desktop/lib/django_test_util.py

commit 8dd90f9b202353bd189f2fa39e4e10decefe2e68
Author: Romain <romain.rigaux@gmail.com>
Date:   Sun Jan 12 02:53:10 2020 -0800

    HUE-8530 [organization] Add org filtering to get document API

:100644 100644 68f7b55210 4190b0de13 M	apps/useradmin/src/useradmin/models.py
:100644 100644 b2822227df a06808571f M	apps/useradmin/src/useradmin/models2.py
:100644 100644 44cecac5e9 861bbe7977 M	apps/useradmin/src/useradmin/models2_tests.py

commit f40db171549fbcbec32d45da4858d61fbbc181be
Author: Romain <romain.rigaux@gmail.com>
Date:   Sun Jan 12 09:55:13 2020 +0100

    HUE-8530 [organization] Add org filtering to get user API

:100644 100644 0ec1b84edf 0ff9d724b1 M	apps/useradmin/src/useradmin/api.py
:100644 100644 54f2ed42be b2822227df M	apps/useradmin/src/useradmin/models2.py
:100644 100644 e7ac2e1717 c5e0c12078 M	desktop/core/src/desktop/settings.py

Harmonization, not 100% finished but the core logic is 80% done.
Flag is off and there is no impact on current Hue

There are a few Python prints that are removed in the follow-up commits

  • 0
  • 0
  • 1
  • 0
  • 1
Description From Last Updated
johan
  1. Ship It!
  2. apps/about/src/about/templates/admin_wizard.mako (Diff revision 1)
     
     
     
     
     
     
    Warp in <li>
  3. 
      
romain
Review request changed

Status: Closed (submitted)

Loading...