HUE-8855 [catalog] Add optional search_cluster config for catalog to limit results to a specific cluster

Review Request #13986 — Created May 31, 2019 and submitted

johan
hue
master
hue
jgauthier, ranade, romain, roohi, weixia, yingc
commit 26047eddde40c436f116f9baf03e5a278b1f44d5
Author: Johan Ahlen <johan@johanahlen.com\>
Date:   Fri May 31 12:27:05 2019 +0200

    HUE-8855 [catalog] Add optional search_cluster config for catalog to limit results to a specific cluster

:100644 100644 f10956413c 6d19dc2539 M	desktop/conf.dist/hue.ini
:100644 100644 e257bb1ff7 e3352adbb9 M	desktop/conf/pseudo-distributed.ini.tmpl
:100644 100644 c26418c791 263f0132f2 M	desktop/libs/metadata/src/metadata/catalog/atlas_client.py
:100644 100644 6b8551bfbd 95db6b8cf3 M	desktop/libs/metadata/src/metadata/conf.py

commit 28560d42f29326afcee84083f39d777d5c8e95ac
Author: Johan Ahlen <johan@johanahlen.com\>
Date:   Fri May 31 11:32:54 2019 +0200

    HUE-8837 [catalog] Fix error when Atlas can't find any entities

:100644 100644 4a0e472317 c26418c791 M	desktop/libs/metadata/src/metadata/catalog/atlas_client.py
Manual on Chrome
  • 0
  • 0
  • 1
  • 1
  • 2
Description From Last Updated
johan
romain
  1. 
      
  2. nit:

    space and bit more pythonic

    atlas_dsl_query = 'from %s where qualifiedName like \'%s*@%s\' limit %s' % (
    atlas_type,
    parentPath,
    get_catalog_search_cluster(),
    limit
    )

  3. Note: in Navigator, this was get_cluster_source_ids() / get_navigator_hue_server_name() in Hue that was pulling up the cluster ID automatically from Nav config

    1. I saw the navigator_hue_server_name but I'm not sure it's the same meaning. One Atlas instance can contain entities from multiple clusters, is that the same for Nav?

      Ideally I think the search_cluster config should be replaced with a list of clusters using the hue configured computes or something and thought we'd take care of that later.

      For now I added this one to at least be able to limit the search result to a specific cluster within one Atlas.

  4. 
      
weixia
  1. 
      
  2. As of now, we need define this as 'cl1' for default cluster, until auto-deployment is settled down, we can decide if we can reuse Navigator's cluster source_id.

  3. 
      
johan
Review request changed

Status: Closed (submitted)

Loading...