tj!dZddlZddlZddlmZddlmZddlmZddl Z ddl m cm Z ddl m Z ddlmZdd lmZdd lmZdd lmZdd lmZmZdd lmZmZddlmZddlm Z ddl!m"Z"m#Z#m$Z$m%Z%m&Z&m'Z'ddl(m)Z)ddl*m+Z+ddl,m-Z-m.Z.m/Z/e&j0e1Z2dZ3dZ4dZ5de j6de j6fdZ7e$deGdde"Z8e$deGd d!e"Z9e$eGd"d#e"Z:Gd$d%e j;Z<Gd&d'e j;Z=Gd(d)e j;Z>Gd*d+e j;Z?Gd,d-e j;Z@Gd.d/e j;ZAGd0d1e j;ZBGd2d3e j;ZCGd4d5e j;ZDGd6d7eZEGd8d9e j;ZFGd:d;e j;ZGGd<d=e j;ZHGd>d?e j;ZI dgdAe j;dBe j6dCe j6dDe j6dEe j6dzdFeJdGeJfdHZKGdIdJe j;ZLGdKdLe j;ZMGdMdNe j;ZNGdOdPe j;ZOGdQdRe j;ZPGdSdTeZQGdUdVe j;ZRGdWdXe j;ZSe$GdYdZeZTGd[d\eTZUe$d]Gd^d_eTZVe$Gd`daeTZWe$GdbdceTZXe$GdddeeTZYgdfZZdS)hzPyTorch CLAP model.N)Callable) dataclass)Any)nn)initialization)ACT2FN)create_bidirectional_mask)GradientCheckpointingLayer)BaseModelOutputBaseModelOutputWithPooling)ALL_ATTENTION_FUNCTIONSPreTrainedModel)Unpack)apply_chunking_to_forward) ModelOutputTransformersKwargsauto_docstringcan_return_tuplelogging torch_int)merge_with_config_defaults)capture_outputs)ClapAudioConfig ClapConfigClapTextConfigc|j\}}}|dddddddfdd|d}||||z|}|S)ae Interpolate data in time domain. This is used to compensate the resolution reduction in downsampling of a CNN. Args: hidden_states (`torch.FloatTensor` of shape (batch_size, time_length, classes_num)): Input hidden states ratio (`int`): The ratio of the length of the output to the length of the input. Nr)shaperepeatreshape) hidden_statesratio batch_size time_length classes_num upsampleds d/var/www/html/CA-Chatbot/venv/lib/python3.11/site-packages/transformers/models/clap/modeling_clap.py interpolater)/sg.;-@*ZkaaaD!!!m,33Aq%CCI!!*kE.A;OOI c|j\}}}}||||z|||z||}|ddddddd|||}|S)aR Returns the resized hidden states. The output shape should be `(batch_size * num_windows, window_size, window_size, num_channels)` Args: hidden_states (`torch.FloatTensor` of shape `(batch_size, height, width, num_channels)`): Input hidden states window_size (`int`): Window size rrrrviewpermute contiguous)r" window_sizer$heightwidth num_channelswindowss r(window_partitionr9@s/<.A+J|!&&Fk);8Lk[gM##Aq!Q155@@BBGGKYdfrssG Nr*c|jd}|d||z||z|||}|ddddddd|||}|S)a Merges windows to produce higher resolution features. Args: windows (`torch.FloatTensor` of shape `(num_windows * batch_size, window_size, window_size, num_channels)`): Input windows window_size (`int`): Window size height (`int`): Height of the resized audio width (`int`): Width of the resized audio r/rrrr,r-r.r0)r8r4r5r6r7s r(window_reverser;Usx=$Lll2v4e{6JKYdfrssGooaAq!Q//::<<AA"feUabbG Nr*logitsreturnctjt||j}tj||S)Ndevice)torcharangelenr@r functional cross_entropy)r<labelss r(contrastive_lossrGjs6 \#f++fm < <