Yes, the types of customizations you are enumerating are persistent to the site, regardless of theme changes. They are indeed commonly recommended to be contained in a plugin.
Personally I consider there is exception from the rule when theme is uniquely developed to the site and de-facto is site project. However I am tad in minority about it and most people insist on plugin approach even in that case.
solved Themes VS Plugins [duplicate]