ELU Layer

• Layer type: ELU
• Doxygen Documentation
• Header: ./include/caffe/layers/elu_layer.hpp
• CPU implementation: ./src/caffe/layers/elu_layer.cpp
• CUDA GPU implementation: ./src/caffe/layers/elu_layer.cu

References

• Clevert, Djork-Arne, Thomas Unterthiner, and Sepp Hochreiter. “Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)” arXiv:1511.07289. (2015).

Parameters

• Parameters (ELUParameter elu_param)
• From ./src/caffe/proto/caffe.proto:

// Message that stores parameters used by ELULayer
message ELUParameter {
  // Described in:
  // Clevert, D.-A., Unterthiner, T., & Hochreiter, S. (2015). Fast and Accurate
  // Deep Network Learning by Exponential Linear Units (ELUs). arXiv
  optional float alpha = 1 [default = 1];
}