ProPeler
Home
Console
Upload
information
Create File
Create Folder
About
Tools
:
/
opt
/
cpanel-ccs
/
txdav
/
who
/
Filename :
groups.pyc
back
Copy
� �t�ac @ s� d Z d d l m Z d d l m Z d d l m Z m Z d d l m Z d d l m Z m Z m Z m Z d d l m Z d d l m Z d d l m Z d d l m Z d d l m Z m Z d d l Z d d l Z d d l Z d d l m Z e � Z d e e e j � f d � � YZ! d e e e j" � f d � � YZ# d e e e j$ � f d � � YZ% d e e e j& � f d � � YZ' d e e e j( � f d � � YZ) d � Z* d e+ f d � � YZ, d S( s Group membership caching i����( t fromTable( t Select( t AggregatedWorkItemt RegeneratingWorkItem( t Logger( t inlineCallbackst returnValuet succeedt DeferredList( t config( t CalendarStoreFeatures( t GroupAttendeeRecord( t GroupsRecord( t schemat _BIND_MODE_OWNN( t Delegatest GroupCacherPollingWorkc B s5 e Z d Z e d � � Z d � Z e d � � Z RS( t group_cacher_pollingc s9 � f d � } t j j r+ | j d | � St d � Sd S( Nc s t j | � � S( N( R t reschedule( t txn( t seconds( s# /opt/cpanel-ccs/txdav/who/groups.pyt _enqueue2 s s& GroupCacherPollingWork.initialSchedule( R t GroupCachingt Enabledt inTransactionR t None( t clst storeR R ( ( R s# /opt/cpanel-ccs/txdav/who/groups.pyt initialSchedule0 s c C s& t | j d d � } | r" | j Sd S( sP Return the interval in seconds between regenerating instances. t _groupCacheri N( t getattrt transactionR t updateSeconds( t selft groupCacher( ( s# /opt/cpanel-ccs/txdav/who/groups.pyt regenerateInterval: s c c s� t | j d d � } | d k r� t j � } y | j | j � VWn& t k rj } t j d d | �n Xt j � } t j d d | | �n d S( NR s5 Failed to update new group membership cache ({error})t errors0 GroupCacher polling took {duration:0.2f} secondst duration( R R R t timet updatet Exceptiont logR$ t debug( R! R" t startTimet et endTime( ( s# /opt/cpanel-ccs/txdav/who/groups.pyt doWorkA s ( t __name__t __module__t groupt classmethodR R# R R. ( ( ( s# /opt/cpanel-ccs/txdav/who/groups.pyR ) s t GroupRefreshWorkc B s& e Z e d � � Z e d � � Z RS( c C s | j j | j k S( N( t tablet GROUP_UIDt groupUID( R! ( ( s# /opt/cpanel-ccs/txdav/who/groups.pyt <lambda>X t c c s� t | j d d � } | d k rz y$ | j | j | j j d � � VWq� t k rv } t j d d | j d | �q� XnR t j d d | j d t j j � t j d d � �| j | j d d | j �Vd S( NR s utf-8s% Failed to refresh group {group} {err}R1 t errs. Rescheduling group refresh for {group}: {when}t whenR i R6 ( R R R t refreshGroupR6 t decodeR( R) R$ R* t datetimet utcnowt timedeltaR ( R! R" R, ( ( s# /opt/cpanel-ccs/txdav/who/groups.pyR. Z s ( R/ R0 t propertyR1 R R. ( ( ( s# /opt/cpanel-ccs/txdav/who/groups.pyR3 V s t GroupDelegateChangesWorkc B s& e Z e d � � Z e d � � Z RS( c C s | j j | j k S( N( R4 t DELEGATOR_UIDt delegatorUID( R! ( ( s# /opt/cpanel-ccs/txdav/who/groups.pyR7 t R8 c c s� t | j d d � } | d k r� yB | j | j | j j d � | j j d � | j j d � � VWq� t k r� } t j d d | j d | �q� Xn d S( NR s utf-8s2 Failed to apply external delegates for {uid} {err}t uidR9 ( R R R t applyExternalAssignmentsRC R< t readDelegateUIDt writeDelegateUIDR( R) R$ ( R! R" R, ( ( s# /opt/cpanel-ccs/txdav/who/groups.pyR. v s ( R/ R0 R@ R1 R R. ( ( ( s# /opt/cpanel-ccs/txdav/who/groups.pyRA r s t GroupAttendeeReconciliationWorkc B s& e Z e d � � Z e d � � Z RS( c C s | j j | j k S( N( R4 t RESOURCE_IDt resourceID( R! ( ( s# /opt/cpanel-ccs/txdav/who/groups.pyR7 � R8 c c s: t | j j � j | j | j � V} | j | j � Vd S( N( R R t _storet calendarObjectWithIDRJ t groupAttendeeChangedt groupID( R! t calendarObject( ( s# /opt/cpanel-ccs/txdav/who/groups.pyR. � s ( R/ R0 R@ R1 R R. ( ( ( s# /opt/cpanel-ccs/txdav/who/groups.pyRH � s t GroupShareeReconciliationWorkc B s& e Z e d � � Z e d � � Z RS( c C s | j j | j k S( N( R4 t CALENDAR_IDt calendarID( R! ( ( s# /opt/cpanel-ccs/txdav/who/groups.pyR7 � R8 c c s� t j } t | j g d | d | j | j k j | j t k � �j | j � V} | r� | d d } | j j | � V} | j | j � V} | d k r� | j j | j � V} | j | j � Vq� n d S( Nt Fromt Wherei ( R t CALENDAR_BINDR t HOME_RESOURCE_IDt CALENDAR_RESOURCE_IDRR t Andt BIND_MODER t onR t calendarHomeWithResourceIDt childWithIDR t groupByIDRN t reconcileGroupShareeR6 ( R! t bindt rowst homeIDt homet calendarR1 ( ( s# /opt/cpanel-ccs/txdav/who/groups.pyR. � s ( R/ R0 R@ R1 R R. ( ( ( s# /opt/cpanel-ccs/txdav/who/groups.pyRP � s c C s� g } g } x^ | j � D]P } | | k r; | j | � q | | | | k r | j | | | f � q q Wx: | j � D], } | | k rz | j | | | f � qz qz W| | f S( s� Compare two proxy assignment lists and return their differences in the form of two lists -- one for added/updated assignments, and one for removed assignments. @param old: dictionary of delegator: (readGroupUID, writeGroupUID) @type old: C{dict} @param new: dictionary of delegator: (readGroupUID, writeGroupUID) @type new: C{dict} @return: Tuple of two lists; the first list contains tuples of (delegator, (readGroupUID, writeGroupUID)), and represents all the new or updated assignments. The second list contains all the delegators which used to have a delegate but don't anymore. ( t iterkeyst append( t oldt newt changedt removedt key( ( s# /opt/cpanel-ccs/txdav/who/groups.pyt diffAssignments� s t GroupCacherc B s� e Z e � Z d d d d e d d d � Z e d � � Z e e d � � Z e d � � Z e d � � Z d � Z d � Z d � Z e d � � Z e d � � Z e d � � Z RS( iX i id i c C sm | | _ | | _ | r3 | d k r3 | j j } n | | _ | | _ | | _ | | _ | | _ | | _ d S( N( t directoryt useDirectoryBasedDelegatesR t" recordsWithDirectoryBasedDelegatest directoryBasedDelegatesSourcet cacheNotifierR t initialSchedulingDelaySecondst batchSizet batchSchedulingIntervalSeconds( R! Rm R Rr Rs Rt Rn Rp Rq ( ( s# /opt/cpanel-ccs/txdav/who/groups.pyt __init__� s c c sg | j r� | j � V} i } x~ | D]v } y | j } Wn t k rO d } n Xy | j } Wn t k rv d } n X| s� | r# | | f | | j <q# q# W| j | | � Vn | j | � V} | j � V} | | } t j j r,t j j � t j d t t j j � � } | j | � V} | | O} n t | � } d } g } xg | r�| | } | | 4t j | t j j | � d t j �V} | j g | D] } | d ^ q�� qGW| r�| j j d d | �n | j } d } x� t | � t | � D]l } | j j d d | d | �t j | | d | �V| d 7} | | j d k r�d } | | j 7} q�q�Wd S( NR id t returnColsi s Deleted old or unused groups {d}t ds0 Enqueuing group refresh for {u} in {sec} secondst ut secR6 i (! Rn Rp t readWriteProxyt AttributeErrorR t readOnlyProxyRD t scheduleExternalAssignmentst groupsToRefresht allGroupsR t AutomaticPurgingR R= R> R? t floatt GroupPurgeIntervalSecondst groupsMissingSincet listR t deletesomeR6 t Int extendR) R* Rr t setR3 R Rs Rt ( R! R Ro t externalAssignmentst recordRz R| t groupUIDst knownGroupUIDst groupsToRemovet dateLimitt missingGroupsRs t deletedGroupUIDst batchR` t rowt futureSecondst iR6 ( ( s# /opt/cpanel-ccs/txdav/who/groups.pyR' � s` ( c c s6 | j � V} t | | � \ } } | r� x� | D]� \ } \ } } | j j d d | �| sf d } n | su d } n | r� | j | | | | � Vq/ t j | d d | d | d | �Vq/ Wn | r2xj | D]_ } | j j d d | �| r| j | | d d � Vq� t j | d d | d d d d �Vq� Wn d S( Ns9 Scheduling external delegate assignment changes for {uid}RD R8 i RC RF RG s; Scheduling external delegation assignment removal for {uid}( t externalDelegatesRk R) R* RE RA R ( R! R t newAssignmentst immediatelyt oldAssignmentsRh Ri RC RF RG ( ( s# /opt/cpanel-ccs/txdav/who/groups.pyR} ? s< c c se | j j d d | �| j | � V\ } } d } } | rm | j | � V} | d k ra d } qm | j } n | r� | j | � V} | d k r� d } q� | j } n | j | | | | | � V| j d k rD| j j | � | r� | j j | � n | r| j j | � n | r(| j j | � n | rD| j j | � qDn t j | | | | | | � Vd S( Ns/ External delegate assignments changed for {uid}RD ( R) R* t externalDelegatesForDelegatorR t groupByUIDRN t assignExternalDelegatesRq Rh R t invalidateExternalAssignment( R! R RC RF RG t previousReadDelegateUIDt previousWriteDelegateUIDt readDelegateGroupIDt writeDelegateGroupIDt readDelegateGroupt writeDelegateGroup( ( s# /opt/cpanel-ccs/txdav/who/groups.pyRE q s: c c s� | j j d d | �| j j | � V} | d k rN | j j d d | �n | j j d d | j �| j | d | d k �V} | r�| j | | � V\ } } } | rz| j j d d | j d | j d d j | � d d j | � �| j d k r=| j j | j � x- t j | | � D] } | j j | � q Wn | j | | j � V} | j | | j � V} t | | � q�| j j d d | j d | j �n t t � � d S( s� Does the work of a per-group refresh work item Faults in the flattened membership of a group, as UIDs and updates the GROUP_MEMBERSHIP table WorkProposal is returned for tests s Refreshing group: {g}t gs Group is missing: {g}s Got group record: {u}Rx t createsL Membership changed for group {uid} {name}: added {added} removed {removed}RD t namet addedt ,Ri s+ No membership change for group {uid} {name}N( R) R* Rm t recordWithUIDR t infoRD R� R; R6 R� t joinRq Rh t itertoolst chaint$ scheduleGroupAttendeeReconciliationsRN t" scheduleGroupShareeReconciliationsR t tuple( R! R R6 R� R1 t membershipChangedt addedUIDst removedUIDsRD t wpsAttendeet wpsShareee( ( s# /opt/cpanel-ccs/txdav/who/groups.pyR; � s6 c C s | j | | � S( N( t synchronizeMembers( R! R RN t newMemberUIDs( ( s# /opt/cpanel-ccs/txdav/who/groups.pyR� � s c C s | j | � S( sF The members of the given group as recorded in the db ( t groupMembers( R! R RN ( ( s# /opt/cpanel-ccs/txdav/who/groups.pyt cachedMembers� s c C s | j | � S( s? The UIDs of the groups the uid is a member of ( t groupUIDsFor( R! R RD ( ( s# /opt/cpanel-ccs/txdav/who/groups.pyt cachedGroupsFor� s c c s t j | d | �V} g } xL | D]D } t j | d t t j j � d | j d | �V} | j | � q# Wt t | � � d S( s� Find all events who have this groupID as an attendee and create work items for them. returns: WorkProposal RN R RJ N( R t querysimpleRH R R� R t GroupAttendeest ReconciliationDelaySecondsRJ Re R R� ( R! R RN t recordst workItemsR� t work( ( s# /opt/cpanel-ccs/txdav/who/groups.pyR� � s c c s� t j } t | j g d | d | j | k �j | � V} g } xR | D]J \ } t j | d t t j j j j � d | d | �V} | j | � qG Wt t | � � d S( s� Find all calendars who have shared to this groupID and create work items for them. returns: WorkProposal RS RT R RR RN N( R t GROUP_SHAREER RQ t GROUP_IDRZ RP R R� R t Sharingt Calendarst GroupsR� Re R R� ( R! R RN t gsR` R� RR R� ( ( s# /opt/cpanel-ccs/txdav/who/groups.pyR� � s c c sL t | j � V� } | j j d d t | � �| j � j � d k rt | j � j � j d t � � d k rt g | j � j � j d t � D]! } | j � j j | | � ^ q� d t �V} x2 | D]* } | r� | d r� | j | d � q� q� W| j j d d t | � �n t j | t j j t j d d d t j f d t � � � V} t g | D] } | j ^ q_� } | j j d d t | � �t j } t j } t | j g d | d | j j t | j g d | d t �� �j | � V} t g | D] } | d ^ q�� } | j j d d t | � �t t | | B| B� � d S( Ns! There are {count} group delegatest countt filter_v5i t consumeErrorsi s8 There are {count} group delegates on this and other podst exprt attributest distincts! There are {count} group attendeesRS RT t Distincts There are {count} group sharees( R� t allGroupDelegatesR) R* t lent directoryServicet serversDBR t allServersExceptThist TrueR R t conduitt send_all_group_delegatesR' R t queryRN R� R t queryExprt frozensetR6 R R� t GROUPSR R5 R� RZ R ( R! R t delegatedUIDst servert resultst resultt groupsR1 t attendeeGroupUIDsR� t grR` R� t shareeGroupUIDs( ( s# /opt/cpanel-ccs/txdav/who/groups.pyR~ sL *C " # N( R/ R0 R R) t FalseR Ru R R' R} RE R; R� R� R� R� R� R~ ( ( ( s# /opt/cpanel-ccs/txdav/who/groups.pyRl � s& N033 (- t __doc__t twext.enterprise.dal.recordR t twext.enterprise.dal.syntaxR t twext.enterprise.jobs.workitemR R t twext.python.logR t twisted.internet.deferR R R R t twistedcaldav.configR t txdav.caldav.datastore.sqlR t$ txdav.caldav.datastore.sql_directoryR t$ txdav.common.datastore.sql_directoryR t! txdav.common.datastore.sql_tablesR R R= R� R& t txdav.who.delegatesR R) t GROUP_CACHER_POLLING_WORKR t GROUP_REFRESH_WORKR3 t GROUP_DELEGATE_CHANGES_WORKRA t GROUP_ATTENDEE_RECONCILE_WORKRH t GROUP_SHAREE_RECONCILE_WORKRP Rk t objectRl ( ( ( s# /opt/cpanel-ccs/txdav/who/groups.pyt <module> s4 " +" "