HUE-1905 [core] Add security handling for yarn and mr2

Review Request #4057 — Created Jan. 23, 2014 and submitted

abec
old-hue-rw
HUE-1905
hue
enricoberti, romain
commit e1601e095f8d1693cfa975e4fa715ecf14d7eaa6
Author: Abraham Elmahrek <abraham@elmahrek.com>
Date:   Thu Jan 23 14:15:02 2014 -0800

    HUE-1905 [core] Add security handling for yarn and mr2
    
    Reuse security_enabled in yarn config section for both yarn and MR2 security.
    Add kerberos handler for all log calls and yarn/mr2 api clients.
    If a particular service is not kerberized, it should still work
    since SPNEGO seems to work with insecure clusters.

:100644 100644 8b27d85... 4aee825... M  apps/jobbrowser/src/jobbrowser/views.py
:100644 100644 def3bcb... 7a50591... M  apps/jobbrowser/src/jobbrowser/yarn_models.py
:000000 100644 0000000... 5f20c80... A  desktop/libs/hadoop/src/hadoop/yarn/clients.py
:100644 100644 d9a38d7... 8254fbe... M  desktop/libs/hadoop/src/hadoop/yarn/history_server_api.py
:100644 100644 b249481... 5a264d1... M  desktop/libs/hadoop/src/hadoop/yarn/mapreduce_api.py
:100644 100644 7f53f8b... 3253465... M  desktop/libs/hadoop/src/hadoop/yarn/node_manager_api.py
:100644 100644 6fd371f... 91b1e9a... M  desktop/libs/hadoop/src/hadoop/yarn/resource_manager_api.py
Tested against kerberized and non-kerberized cluster.
  • 1
  • 0
  • 0
  • 0
  • 1
Description From Last Updated
log_link is unique so the cache is going to leak and we will OOM at some point? should we use ... romain romain
romain
  1. 
      
  2. log_link is unique so the cache is going to leak and we will OOM at some point?
    
    should we use the hostname instead?
    1. Good point. Will put it into a Queue or set.
  3. 
      
abec
abec
abec
romain
  1. 
      
  2. desktop/libs/hadoop/src/hadoop/yarn/clients.py (Diff revision 4)
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
     
    client = get_client_from heap
    
    if client is None:
      client = new client
    else:
       remove client
    
    client_tuple = (time(), client)
    if heap >= MAX:
      heap.replace(client_tuple)
    else:
      heap.push(client_tuple)
    
    return client
  3. 
      
abec
abec
Review request changed

Status: Closed (submitted)

Loading...