7 Commits

Author	SHA1	Message	Date
Jagrit Digani	6686e61ca4	Reduce update (#783) ... * Split reduction files to reduce compile times * Add small and medium axis size specializations for row reductions * Add non-row-reduction options for small and med kernels	2024-03-04 19:09:51 -08:00
Angelos Katharopoulos	dfa9f4bc58	An initial quantized matmul implementation (#205) ... * Add quantized matvec * Add quantized matrix matrix with 2nd matrix transposed * Add quantized matmul tests * Add a slow cpu quantized matmul * Add a slightly faster vectorized cpu version	2023-12-18 23:18:57 -08:00
Diogo	02de234ef0	Activations LeakyReLU / PReLU / Softplus / Mish (#109) ... * Leaky_relu / prelu / softplus / mish * added tests * updated bench * remove torch refs, add init to PReLU * added arvix reference to mish * added missing docs	2023-12-11 19:40:57 -08:00
Nicholas Santavas	f5df47ec6e	Add Step, ELU, SELU, Swish activation functions (#117) ... * Add Step, ELU, SELU, Swish activation functions This commit adds the Step, ELU, SELU and Swish activations functions * add to the docs * review	2023-12-11 17:04:07 -08:00
Jason	b0cd092b7f	Added activation functions: leaky_relu relu6 softplus elu celu logsigmoid (#108) ... * added leaky_relu relu6 softplus elu celu logsigmoid * minor fixes for docstring and benchmark imports * fixed elu implementation and added tests * added tests for optional param, changed leaky_relu param to fit pytorch documentation	2023-12-10 16:31:38 -08:00
Awni Hannun	46a39e5b1f	copyright + ack	2023-11-30 11:12:53 -08:00
Awni Hannun	8ca7f9e8e9	awni's commit files	2023-11-29 10:30:41 -08:00