a < be@sddlmZddlZddlZddlZddlZddlmm Z ddl m Z ddl Zddl mZmZddlmZddlmZddlmmZejZeedZejddgd d d ZGd d d ZGdddZ GdddZ!GdddZ"GdddZ#GdddZ$ddZ%ej&'dej(dfej)dfej*dfej+dfej,dfej-dfej.dfej/dfej0dfej1dfg dd Z2ej&'d!ej3ej4ej)ej+ej-ej5ej6ej7ej8ej9ej1ej0ej:ej;ejd?Z4e"j#d@dAZ5e"j#dBdCZ6e"j#dDdEZ7dFdGZ8dHdIZ9e j dJe:j;e jfe:j?e j@fe:jAe jBfe:jCe jDfe:jEe jFfgdKdLZGdMdNZHdOdPZIdQdRZJdS)ZTestnanopsDataFramec Cstjddt_d}tjj||_tjj||_|j|jd|_tj dd||_ tj dd|dk|_ t |j d |_t |j d |_tj dd | d |_tj dd | d |_ttj||_t|j|jg|_t|j|jg|_t|j|jg|_t|j|jg|_|jtj|_t|j|jg|_t|j|jg|_t|j|j|jg|_t|j|j|jg|_t|j d|j d|j d|j d|j d|j d|j d|j dg|_ tj!ddV|j|jd|_"t|j|j"g|_#|jd|_$t|j|j$g|_%Wdn1sP0Y|j|_&|j|_'|j|_(|j|_)|j|_*|j|_+|jdddf|_,|jdddf|_-|jdddf|_.|jdddf|_/|jdddf|_0|jdddf|_1dS)Ni+F) y?i rSUi NM8[ns]m8[ns]Oignoreinvalid)2nprandomseednanops_USE_BOTTLENECKZrandn arr_float arr_float1 arr_complexrandintarr_intarr_boolabsastypearr_strarr_utfarr_date arr_tdeltaZtilenanarr_nanvstack arr_float_nanarr_float1_nanarr_nan_float1 arr_nan_naninfarr_inf arr_float_inf arr_nan_infarr_float_nan_infarr_nan_nan_infarr_objerrstate arr_nan_nanjarr_complex_nan arr_nan_infjarr_complex_nan_infj arr_float_2d arr_float1_2d arr_nan_2darr_float_nan_2darr_float1_nan_2darr_nan_float1_2d arr_float_1d arr_float1_1d arr_nan_1darr_float_nan_1darr_float1_nan_1darr_nan_float1_1d)selfmethodZ arr_shaper r r setup_method"sd           4z TestnanopsDataFrame.setup_methodcCs tt_dSN)use_bnrrrJrKr r r teardown_methodbsz#TestnanopsDataFrame.teardown_methodTcCs6t|d|}|dkrLt|drL|jrL|j|jkrLtj||jdgddd}ztj|||dWnty0t|dr|j dkrt|dr|j j dvr|j j d kr|j j d kr| |j }qt rd nd }| |}| |}n|j j d krtjt |t ||dtjt|t||dYn0dS) NZasm8rshapeaxis check_dtypedtyper)crrc16f8)getattrhasattrndimrQrsplittmassert_almost_equalAssertionErrorrVkindr&has_c16realimag)rJtargresrSrUZ cast_dtyper r r check_resultses6        z!TestnanopsDataFrame.check_resultsNcKstt|jdgD]<} |r"|n|} |rP|rPt| rP|| fd| i|} n|| fd| i|} | jtkr|tjus|tjurt | tj r| t } nt | } ||f| |d|} |j | | | |d|r||fd| i|} |j | | | |d| dur$||fd|i|} |j | | | |d|r| dur||fi|} |j | | | |dq|jdkrddStj|ddd} tj|ddd}|j||| |f|||d |dS) NrSrSr rTr rrR)r rUempty_targfunc)listranger\rallrVobjectrany isinstancendarrayr&boolrgtakecheck_fun_data)rJtestfunctargfunc testarval targarvalr rUrkkwargsrSZ targartempvalrerfZ testarval2Z targarval2r r r rusP        z"TestnanopsDataFrame.check_fun_datac Ksb|}|dr,t||ddr,|dd}t||}t||} |j|||| f||d|dS)NZ_nan)r rk)endswithr[rZru) rJrvrwZtestarr rkrzZtargarrxryr r r check_funs    zTestnanopsDataFrame.check_func Ks|j||d|fi| |j||d|fi| |j||d|fi| |j||d|fi| |jd|jd|jdg} |r|j||d|fi| |r|j||d|fi| |j||d|fi| |r|j||d |fi| | |jdg7} |r<||j|j||d |fi| | |jdg7} |rz||jWntydYn,0|j||d |fi| | |jdg7} |rt | |_ |d krt |j ||d }|j||d|fi| dS)Nrr.r#r$rr,r!r;r:r)r*convert)func allow_complexr8)r}rr&r#r$r!r)r* TypeErrorrr-r8r _badobj_wrap) rJrvrwr r allow_all_nan allow_date allow_tdelta allow_objrzobjsr r r check_funssD       zTestnanopsDataFrame.check_funscKs6|jjdkr&|r|d}n |d}||fi|S)NrrXrY)rVrar&)rJvaluerrrzr r r rs    z TestnanopsDataFrame._badobj_wrapz nan_op,np_opcCs|j|||ddddS)NF)rr)rrJZnan_opZnp_opr r r r test_nan_funcssz"TestnanopsDataFrame.test_nan_funcscCs |jtjtj|ddtjddS)NF)rrUrk)rrnansumrsumrJr r r r test_nansum szTestnanopsDataFrame.test_nansumcCs|jtjtj|ddddS)NF)rr)rrnanmeanrmeanrr r r test_nanmean*sz TestnanopsDataFrame.test_nanmeancCs\dD]R}t|tdtjd}|}|j}||ks:J||ksFJ|jtjksJqdS)N)lll|H%[<i)indexrV)rrmrint64rvaluesrVfloat64)rJasresultZ np_resultr r r test_nanmean_overflow/s   z)TestnanopsDataFrame.test_nanmean_overflowrVZfloat128cCsz|dur dSttd|d}gd}ddg}||D]@}t||}t|rf||vrf|jtjkstJq4|j|ks4Jq4dS)NrrV)rstdvarskewkurtminmax)rrmrZrrVrr)rJrVrZgroup_aZgroup_brKrr r r test_returned_dtype<s   z'TestnanopsDataFrame.test_returned_dtypec CsVtjdd6tdt|jtjtj|ddddWdn1sH0YdS)NTrecordrFr~)rrr) warningscatch_warnings simplefilterRuntimeWarningrr nanmedianrmedianrr r r test_nanmedianVs z"TestnanopsDataFrame.test_nanmedianddofc Cs |jtjtj|ddd|ddSNFr~)rrrr)rrnanvarrrrJrr r r r test_nanvarbszTestnanopsDataFrame.test_nanvarc Cs |jtjtj|ddd|ddSr)rrnanstdrrrr r r test_nanstdnszTestnanopsDataFrame.test_nanstdc CsXddlm}tjdd,|jtj||dddd|dWdn1sJ0YdS)Nr)semrrFr~)rrrrr) scipy.statsrrr9rrnansem)rJrr rr r r test_nansemzs zTestnanopsDataFrame.test_nansemcCsNtjdd.tdt|j|||ddWdn1s@0YdS)NTrrFr)rrrrrrr r r test_nanops_with_warningss z-TestnanopsDataFrame.test_nanops_with_warningscCsV|||}t||}t|}|jr.d||<n$t|dr@|sNt|dsR|rRd}|S)Nrjrn)rrrr\r[rn)rJrrSrrfZnansZnullnanr r r _argminmax_wraps   z#TestnanopsDataFrame._argminmax_wrapcCs`tjdd@tdtt|jtjd}|jt j ||ddWdn1sR0YdSNTrrrFr) rrrrrrrZargmaxrr nanargmaxrJr rr r r test_nanargmaxs z"TestnanopsDataFrame.test_nanargmaxcCs`tjdd@tdtt|jtjd}|jt j ||ddWdn1sR0YdSr) rrrrrrrZargminrr nanargminrr r r test_nanargmins z"TestnanopsDataFrame.test_nanargmincCstt|jjtjs|d}|||dd}t|tjrXd|tj||dtj||dk<|St|t|krpdS|S)NrYF)rSZbiasrrR) rqrVtyperZfloatingr&rrrr)rJrrSrrr r r _skew_kurt_wraps   z#TestnanopsDataFrame._skew_kurt_wrapc Csbddlm}t|j|d}tjdd(|jtj||ddddWdn1sT0YdS)Nr)rrrrFrrr) rrrrrr9rrnanskew)rJr rrr r r test_nanskews z TestnanopsDataFrame.test_nanskewc Csnddlm}t|dd}t|j|d}tjdd(|jtj||dddd Wdn1s`0YdS) Nr)kurtosisT)ZfisherrrrFr) rrrrrr9rrnankurt)rJr rZfunc1rr r r test_nankurts  z TestnanopsDataFrame.test_nankurtcCs |jtjtj|ddtjddS)NF)rrrk)rrnanprodrprodrr r r test_nanprodsz TestnanopsDataFrame.test_nanprodcKs||j|jfi|}||j|jfdt|jdi|}t||t||||j|jfi|}||j|jfdt|jdi|}t||t||tj} ||j |jfi|} ||j|j fi|} ||j |j fi|} ||j|j fi|} ||j|j fdt|jdi|}||j|jfdt|jdi|}t| | t| | t| | t| | t| |t| |dSNZ min_periodsri) r>r?lenr^r_rArBrr+r@rCrJcheckfuntarg0targ1rzZres00Zres01Zres10Zres11targ2Zres20Zres21Zres22Zres23Zres24Zres25r r r check_nancorr_nancov_2dsb             z+TestnanopsDataFrame.check_nancorr_nancov_2dcKs||j|jfi|}||j|jfdt|jdi|}t||t||||j|jfi|}||j|jfdt|jdi|}t||t||tj} ||j |jfi|} ||j|j fi|} ||j |j fi|} ||j|j fi|} ||j|j fdt|jdi|}||j|jfdt|jdi|}t| | t| | t| | t| | t| |t| |dSr) rDrErr^r_rGrHrr+rFrIrr r r check_nancorr_nancov_1dsb             z+TestnanopsDataFrame.check_nancorr_nancov_1dcCst|j|jd}t|jj|jjd}|tj||t|j|j d}t|jj|j jd}|j tj||dddSNrriZpearsonrK rcorrcoefr>r?flatrrnancorrrDrErrJrrr r r test_nancorr=s z TestnanopsDataFrame.test_nancorrcCst|j|jd}t|jj|jjd}|jtj||ddt|j|j d}t|jj|j jd}|j tj||dddSrrrr r r test_nancorr_pearsonEs z(TestnanopsDataFrame.test_nancorr_pearsoncCsddlm}||j|jd}||jj|jjd}|jtj||dd||j|j d}||jj|j jd}|j tj||dddS)Nr) kendalltauZkendallr) rrr>r?rrrrrDrEr)rJrrrr r r test_nancorr_kendallMs z(TestnanopsDataFrame.test_nancorr_kendallcCsddlm}||j|jd}||jj|jjd}|jtj||dd||j|j d}||jj|j jd}|j tj||dddS)Nr) spearmanrZspearmanr) rrr>r?rrrrrDrEr)rJrrrr r r test_nancorr_spearmanXs z)TestnanopsDataFrame.test_nancorr_spearmancCsvt|j|jd}t|jj|jjd}d}tjt|d$|jt j ||ddWdn1sh0YdS)Nrz;Unknown method 'foo', expected one of 'kendall', 'spearman'matchfoor) rrr>r?rpytestraises ValueErrorrrr)rJrrmsgr r r test_invalid_methodcs z'TestnanopsDataFrame.test_invalid_methodcCs|t|j|jd}t|jj|jjd}|tj||t|j|j d}t|jj|j jd}| tj||dS)Nr) rZcovr>r?rrrZnancovrDrErrr r r test_nancovks zTestnanopsDataFrame.test_nancovcCs.|j}|j}|j}|j}|j}|j}|j} |jr*|||} t || |jdkrbt ||g} nt ||g} |||} tj | | dd|} ||| }tj | |ddt j|ddd}t j|ddd}t j|ddd}t j|ddd}t j|ddd}t j|ddd}t j| ddd} t j|ddd}q*dS)NriFrTrrjrR)rr r,r1r.r/r0r\r^r_rr-hstackassert_numpy_array_equalrt)rJrrrr r,r1r.r/r0res0rZres1rZres2r r r check_nancompss4     z!TestnanopsDataFrame.check_nancompzop,nanopcCs||j|j}|||dSrM)rr r)rJopZnanoprr r r test_nan_comparisons z'TestnanopsDataFrame.test_nan_comparisoncCsLt|ddrH||}|r"|s*Jn|r*Jt|ds6qHtj|ddd}qdS)Nr\TrrjrR)rZr[rrt)rJrrcorrectrr r r check_bools   zTestnanopsDataFrame.check_boolcCsgd}gd}|D]"\}}t||}|tj||q|D]N\}}t||}|tj|||tj|d||tj|d|qsz&TestNanvarFixedValues.test_nanvar_ddofrSrrrcCs td}tgdgdgdg|ddddf<tj|d<|dddf<tgdgdgdggd gd gd gg}tj|d ||d }t|dd|||ft|dsJtj |d ||d }t|dd|||fdt|dsJdS)N)r5)g*f#?g|9?gֆ?)gvZ?gן?gצʺ?)g6bڷ?gE-9?g$mxP?r)gӞ?g/-:Ŭ?g??)g-ull?g(I0쓵?gM6?)g-ull?gF?gmɉM6?)g ^?g)܌ ?g쵇Z&?)g@#)G?g/TS?g6܃?)g@#)G?g/TS?gSW_܃?T)r rSrr) remptyrr+rrr^r_isnanr)rJrSrr$r!rrr r r test_ground_truthQs2  z'TestNanvarFixedValues.test_ground_truthcCs.tdtd}|j|d}|dks*JdS)Ni-r)rr)rrr+r)rJrdatarr r r test_nanstd_roundoffys z*TestNanvarFixedValues.test_nanstd_roundoffcCs tjdSNirrZ RandomStaterr r r r"szTestNanvarFixedValues.prngN)rrrrLr)r,r-r1r4rrrrmr8r:propertyr"r r r r rs    & rc@sPeZdZddZddZddZddZd d Zd d Zd dZ e ddZ dS)TestNanskewFixedValuescCs ttddd|_d|_dS)Nrrig5ȿ)rsinlinspacer$ actual_skewrOr r r rLsz#TestNanskewFixedValues.setup_methodcCs2dD](}|td}t|}|dksJqdS)Ngfffff@g@g@,r)rr+rr)rJrr9rr r r test_constant_seriess z+TestNanskewFixedValues.test_constant_seriescCs\d\}}|jj||dd}t|dks,Jd\}}|jj||dd}t|dksXJdSN)333333?皙?dr.r)rHrG)r"betarrrJalpharJZ left_tailedZ right_tailedr r r test_all_finites z&TestNanskewFixedValues.test_all_finitecCst|j}t||jdSrM)rrr$r^r_rB)rJrr r r r8s z(TestNanskewFixedValues.test_ground_truthcCsNt|jtjtt|jg}tj|dd}t |t |j tjgdSNrirR) rr-r$r+r+rrrr^r_rrBrJr$rr r r test_axiss"z TestNanskewFixedValues.test_axiscCs2t|jtjg}tj|dd}t|s.JdSNFr*)rrr$r+rrr7rOr r r test_nanssz TestNanskewFixedValues.test_nanscCs2t|jtjg}tj|dd}t||jdSNTr*) rrr$r+rrr^r_rBrOr r r test_nans_skipnasz'TestNanskewFixedValues.test_nans_skipnacCs tjdSr;r<rr r r r"szTestNanskewFixedValues.prngN) rrrrLrErMr8rPrRrTr=r"r r r r r>s r>c@sbeZdZddZejdgdddZddZd d Z d d Z d dZ ddZ e ddZdS)TestNankurtFixedValuescCs ttddd|_d|_dS)Nrrir?g|vK)rr@rAr$ actual_kurtrOr r r rLsz#TestNankurtFixedValues.setup_methodrrCcCs(|td}t|}|dks$JdS)NrDr)rr+rr)rJrr9rr r r rEs z+TestNankurtFixedValues.test_constant_seriescCs\d\}}|jj||dd}t|dks,Jd\}}|jj||dd}t|dksXJdSrF)r"rJrrrKr r r rMs z&TestNankurtFixedValues.test_all_finitecCst|j}t||jdSrM)rrr$r^r_rV)rJrr r r r8s z(TestNankurtFixedValues.test_ground_truthcCsNt|jtjtt|jg}tj|dd}t |t |j tjgdSrN) rr-r$r+r+rrrr^r_rrVrJr$rr r r rPs"z TestNankurtFixedValues.test_axiscCs2t|jtjg}tj|dd}t|s.JdSrQ)rrr$r+rrr7rWr r r rRsz TestNankurtFixedValues.test_nanscCs2t|jtjg}tj|dd}t||jdSrS) rrr$r+rrr^r_rVrWr r r rTsz'TestNankurtFixedValues.test_nans_skipnacCs tjdSr;r<rr r r r"szTestNankurtFixedValues.prngN)rrrrLrrrrErMr8rPrRrTr=r"r r r r rUs  rUc@s.eZdZddZejdddgddZdS) TestDatetime64NaNOpscCstjddd}|d}|t|t|fD]}t|}||ks(Jq(|dtj}|t|t|fD]}t|}||ksdJqddS)Nz 2016-01-01r)Zperiodsri)pdZ date_rangerrrrinsertNaT)rJZdtiexpectedobjrZdti2r r r rs  z!TestDatetime64NaNOps.test_nanmeanrVrrcCstdtj|dd}d|d<tj|dd}|tj usDJtj|ddd }tj gd |j d }t ||tj|d dd }t |d |d|d|dg}t ||dS)N r5rr[)rjrjFr*rrh)r5r2r[rrir)riri)rri)rZaranger&rviewZreshaperrrYr[rrVr^r)rJrVrrr\r r r test_nanmean_skipna_falses  "z.TestDatetime64NaNOps.test_nanmean_skipna_falseN)rrrrrrrr`r r r r rXsrXcCsJtjrFtddtds Jtddtdr:JtdtdS)NZuse_bottleneckTF)rZ_BOTTLENECK_INSTALLEDrYZ set_option get_optionrNr r r r test_use_bottleneck s   rbznumpy_op, expectedrg@rir5cCs |tgd}||ksJdS)N)rirrr5)r)Znumpy_opr\rr r r test_numpy_opssrc operationcCsDtddtjdtjdg}|}||}|||d}||ks@JdS)Nrirrr5)mask)rrr+r)rdrreZmedian_expectedZ median_resultr r r %test_nanops_independent_of_mask_param-s  rf)> functoolsrr rZnumpyrrZpandas.util._test_decoratorsutilZ_test_decoratorsrZpandas.core.dtypes.commonrZpandasrYrrZpandas._testingZ_testingr^Zpandas.core.arraysrZpandas.core.nanopscorerrrNr[rbZfixturer r rrr>rUrXrbrrrrrrrrrrrrrcrrrrrrrrrrrfr r r r s|      E0u11#