Searching part-specific neural fabrics for human pose estimation

作者:

Highlights:

• We propose a novel micro and macro gradient-based architecture search space: parameterized cell-based neural fabric (CNF).

• With simple prior knowledge as guidance, our method automatically searches part-specific neural architectures to localize disentangled body parts, which extends the traditional part-based methods.

• Such part-specific neural architecture search can be seen as a variant of multi-task learning. It is a novel solution as multi-task neural architecture search for human pose estimation.

• The experiments show that the proposed model outperforms a hand-crafted part-based baseline model, and the resulting multiple part-specific architectures gain significant performance improvement against a single NAS-based architecture for the whole-body representation.

摘要

•We propose a novel micro and macro gradient-based architecture search space: parameterized cell-based neural fabric (CNF).•With simple prior knowledge as guidance, our method automatically searches part-specific neural architectures to localize disentangled body parts, which extends the traditional part-based methods.•Such part-specific neural architecture search can be seen as a variant of multi-task learning. It is a novel solution as multi-task neural architecture search for human pose estimation.•The experiments show that the proposed model outperforms a hand-crafted part-based baseline model, and the resulting multiple part-specific architectures gain significant performance improvement against a single NAS-based architecture for the whole-body representation.

论文关键词:Human pose estimation,Neural architecture search,Cell-based neural fabrics,Micro and macro search space,Prior knowledge,Part-specific

论文评审过程:Received 23 May 2021, Revised 28 February 2022, Accepted 12 March 2022, Available online 21 March 2022, Version of Record 29 March 2022.

论文官网地址:https://doi.org/10.1016/j.patcog.2022.108652