Pi_ ddlZddlmZddlmZddZejdZejddej fdZ ejddej fdZ dS) N)TensorDescriptorct|}tj}t|}|dkr||z }d|cxkr |dz ks nJd|dks Jdt||ks Jdd}d}|||ks Jd |||<|}d |z |gfd t |Dz}||g|z} ddg|z} t | || S) a Given a 2- or 3-dimensional tensor T, this creates a 'ragged descriptor' which behaves like a concatenation (along the first axis) of subarrays of potentially unequal size. The load_ragged and store_ragged device functions can be used to read and write from subarrays T[batch_offset : batch_offset + batch_size] with hardware bounds-checking preventing any sort of leakage outside the subarray. rzlast dimension cannot be raggedzz,create_ragged_descriptor..)s#:\:\:\1188A;;:\:\:\)listshapelenr ranger) r block_shape ragged_dim tensor_shaperankmax_intbillion ragged_stride tma_stride tma_shape box_shapes ` rcreate_ragged_descriptorrsQ{##K==L |  DA~~d % % % %TAX % % % % %'H % % % 1999T999 {  t # # #%X # # #GG  #w . . .0U . . .&LHHZ((M-'7:\:\:\:\PUVZP[P[:\:\:\\J7#l2IQ+%I Ay*i @ @@rc*d}||z |z}||z}|||fS)z; Helper function for load_ragged and store_ragged. rr ) batch_offset batch_sizerowrxys rto_ragged_indicesr&0s. G*s"Az!A Aq=rrc^tjt|jt|dzkdt ||||\}}}|||g|d|z|gz||dzdz}tj||jdd}|S)z Read from a subarray T[batch_offset : batch_offset + batch_size] with hardware bounds-checking, where reading outside the subarray gives zeros. Coords should be an appropriately-sized list of integers, just like in TMA.load(). z*TMA must be a read-write ragged descriptorNr)tl static_assertrrr&loadreshape) TMAr!r"coordsrc0c1c2datas r load_raggedr3=sS^^s6{{Q68deee"<VJ=OPPJBB 88RHvkzk22bT9F:PQ>??r=s ;;;;;; %A%A%A%AP    2< " U U", U U U  U U Ur