HUE-7258 [jb] Add config check for Spark history server URL

Review Request #13430 - Created Oct. 8, 2018 and updated

Ying Chen
hue
master
HUE-7258
hue
enricoberti, jgauthier, johan, romain, weixia
commit ed9f43080264330c75f417191c47a353a7957f31 (HEAD -> master)
Author: Ying Chen <yingchen@cloudera.com>
Date:   Mon Oct 8 17:18:00 2018 -0700

    HUE-7258 [jb] Add config check for Spark history server URL

:100644 100644 b8d261fca2... 65aeab0850... M    desktop/libs/hadoop/src/hadoop/conf.py


  • 1
  • 0
  • 0
  • 1
  • 2
Description From Last Updated
Is there a way to know that the Spark service is intalled? (to not show the warning if Spark is ... Romain Rigaux
  1. Nice one, just on question

  2. desktop/libs/hadoop/src/hadoop/conf.py (Diff revision 1)
     
     

    Never used bind_to, would it be the same as something like cluster.SPARK_HISTORY_SERVER_URL.get() ?

    1. Yes, it's the string of the URL.
  3. 
      
Review request changed
  1. 
      
  2. desktop/libs/hadoop/src/hadoop/conf.py (Diff revision 2)
     
     

    Is there a way to know that the Spark service is intalled?
    (to not show the warning if Spark is not there)

    1. CM API has rest API, http://example.com:7180/api/v19/clusters/Cluster%201/services/ for type of "SPARK_ON_YARN", but we also need to host of CM and the name of cluster.
      
      I tried cluster.SPARK_HISTORY_SERVER_URL.get(), but this will always return it default value "localhost:18088"
  3. 
      
Loading...