최소 단어 이상 선택하여야 합니다.
최대 10 단어까지만 선택 가능합니다.
다음과 같은 기능을 한번의 로그인으로 사용 할 수 있습니다.
NTIS 바로가기전자통신동향분석 = Electronics and telecommunications trends, v.38 no.5, 2023년, pp.12 - 22
김혜지 (초거대AI반도체연구실) , 여준기 (초거대AI반도체연구실)
The development of neural networks is evolving towards the adoption of transformer structures with attention modules. Hence, active research focused on extending the concept of lightweight neural network algorithms and hardware acceleration is being conducted for the transition from conventional con...
T. Brown et al., "Language models are few-shot?learners," in Proc. NeurIPS 2020, (Vancouver, Canada),?Dec. 2020, pp. 1877-1901.
C.H. Lin et al., "Magic3d: High-resolution text-to-3d content creation," in Proc. IEEE/CVF CVPR 2023,?(Vancouver, Canada), June 2023, pp. 300-309.
U. Singer et al., "Make-a-video: Text-to-video?generation without text-video data," arXiv preprint,?CoRR, 2022, arXiv: 2209.14792.
R. Huang et al., "Make-an-audio: Text-to-audio?generation with prompt-enhanced diffusion models,"?arXiv preprint, CoRR, 2023, arXiv: 2301.12661.
A. Vaswani et al., "Attention is all you need," in Proc.?NIPS 2017, (Long Beach, CA, USA), Dec. 2017.
https://openai.com/blog/chatgpt
R. Rombach et al., "High-resolution image synthesis?with latent diffusion models," in Proc. IEEE/CVF CVPR?2022, (New Orleans, LA, USA), June 2022, pp. 10684-10695.
C. Yu et al., "Boost Vision Transformer with GPU-Friendly Sparsity and Quantization," in Proc. IEEE/CVF?CVPR 2023, (Vancouver, Canada), June 2023, pp.?22658-22668.
J. Shin et al., "NIPQ: Noise proxy-based integrated?pseudo-quantization," in Proc. IEEE/CVF CVPR 2023,?(Vancouver, Canada), June 2023, pp. 3852-3861.
G. Fang et al., "Depgraph: Towards any structural?pruning," in Proc. IEEE/CVF CVPR 2023, (Vancouver,?Canada), June 2023, pp. 16091-16101.
S. Wei et al., "Joint token pruning and squeezing?towards more aggressive compression of vision?transformers," in Proc. IEEE/CVF CVPR 2023,?(Vancouver, Canada), June 2023, pp. 2092-2101.
Y. Rao et al., "Dynamicvit: Efficient vision transformers?with dynamic token sparsification," in Proc. NeurIPS?2021, (Virtual-only), Dec. 2021, pp. 13937-13949.
E. Jang, S. Gu, and B. Poole, "Categorical?reparameterization with gumbel-softmax," arXiv?preprint, CoRR, 2016, arXiv: 1611.01144.
L. Youwei et al., "Not all patches are what you?need: Expediting vision transformers via token?reorganizations," arXiv preprint, CoRR, 2022, arXiv:?2202.07800.
H. Yang et al., "Global vision transformer pruning with?hessian-aware saliency," in Proc. IEEE/CVF CVPR 2023,?(Vancouver, Canada), June 2023, pp. 18547-18557.
S.M. Moosavi-Dezfooli et al., "Robustness via curvature?regularization, and vice versa," in Proc. IEEE/CVF CVPR?2019, (Long Beach, CA, USA), June 2019, pp. 9078-9086.
Y. Huanrui et al., "Hero: Hessian-enhanced robust?optimization for unifying and improving generalization?and quantization performance," arXiv preprint, CoRR,?2021, arXiv: 2111.11986.
Y. Shixing et al., "Hessian-aware pruning and optimal?neural implant," in Proc. IEEE/CVF WACVi 2022, (Waikoloa, HI, USA), Jan. 2022, pp. 3880-3891.
H. Wang, Z. Zhang, and S. Han, "Spatten: Efficient?sparse attention architecture with cascade token and?head pruning," in Proc. IEEE HPCA 2021, (Seoul, Rep.?of Korea), Feb. 2021.
Y. Qin et al., "FACT: FFN-attention Co-optimized?transformer architecture with eager correlation?prediction," in Proc. ISCA 2023, (Orlando, FL, USA),?June 2023, pp. 1-14.
*원문 PDF 파일 및 링크정보가 존재하지 않을 경우 KISTI DDS 시스템에서 제공하는 원문복사서비스를 사용할 수 있습니다.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.