HUE-7258 [jb] Add config check for Spark history server URL

Review Request #13430 - Created Oct. 8, 2018 and updated Oct. 10, 2018, 11:31 a.m.

Information
Owner:	Ying Chen
Repository:	hue
Branch:	master
Bugs:	HUE-7258
Depends On:
Reviewers
Groups:	hue
People:	enricoberti, jgauthier, johan, romain, weixia

Description

commit ed9f43080264330c75f417191c47a353a7957f31 (HEAD -> master)
Author: Ying Chen <yingchen@cloudera.com>
Date:   Mon Oct 8 17:18:00 2018 -0700

    HUE-7258 [jb] Add config check for Spark history server URL

:100644 100644 b8d261fca2... 65aeab0850... M    desktop/libs/hadoop/src/hadoop/conf.py

Testing Done

Issues

1
0
0
1
All Issues: 2

Description	From	Last Updated
Never used bind_to, would it be the same as something like cluster.SPARK_HISTORY_SERVER_URL.get() ?	Romain Rigaux	Oct. 9, 2018, 2:08 p.m.
Is there a way to know that the Spark service is intalled? (to not show the warning if Spark is ...	Romain Rigaux	Oct. 10, 2018, 8:42 a.m.

```
Nice one, just on question
```

desktop/libs/hadoop/src/hadoop/conf.py (Diff revision 1)

Show all issues

Never used bind_to, would it be the same as something like cluster.SPARK_HISTORY_SERVER_URL.get() ?

Ying Chen Oct. 9, 2018, 2:08 p.m.
```
Yes, it's the string of the URL.
```

Diff:

Revision 2 (+18)

Show changes

desktop/libs/hadoop/src/hadoop/conf.py

Fix it!

desktop/libs/hadoop/src/hadoop/conf.py (Diff revision 2)

Show all issues

Is there a way to know that the Spark service is intalled?
(to not show the warning if Spark is not there)

Ying Chen Oct. 10, 2018, 11:31 a.m.

CM API has rest API, http://example.com:7180/api/v19/clusters/Cluster%201/services/ for type of "SPARK_ON_YARN", but we also need to host of CM and the name of cluster.

I tried cluster.SPARK_HISTORY_SERVER_URL.get(), but this will always return it default value "localhost:18088"

You have a pending review.

Review Board 3.0.3

HUE-7258 [jb] Add config check for Spark history server URL

Diff: