{"id":21178,"date":"2022-11-12T11:55:11","date_gmt":"2022-11-12T06:25:11","guid":{"rendered":"https:\/\/jassweb.com\/solved\/solved-is-use-of-leaky-relu-after-batch-normalization-bn-is-useful\/"},"modified":"2022-11-12T11:55:11","modified_gmt":"2022-11-12T06:25:11","slug":"solved-is-use-of-leaky-relu-after-batch-normalization-bn-is-useful","status":"publish","type":"post","link":"https:\/\/jassweb.com\/solved\/solved-is-use-of-leaky-relu-after-batch-normalization-bn-is-useful\/","title":{"rendered":"[Solved] Is use of Leaky ReLu after Batch Normalization (BN) is useful"},"content":{"rendered":"<p> [ad_1]<br \/>\n<\/p>\n<div id=\"answer-52014864\" class=\"answer js-answer accepted-answer js-accepted-answer\" data-answerid=\"52014864\" data-parentid=\"52004374\" data-score=\"2\" data-position-on-page=\"1\" data-highest-scored=\"1\" data-question-has-accepted-highest-score=\"1\" itemprop=\"acceptedAnswer\" itemscope itemtype=\"https:\/\/schema.org\/Answer\">\n<div class=\"post-layout\">\n<div class=\"votecell post-layout--left\"><\/div>\n<div class=\"answercell post-layout--right\">\n<div class=\"s-prose js-post-body\" itemprop=\"text\">\n<p>The BN layer tries to zero-mean its output by subtracting an expectation over inputs. So we can expect some of its output values to be negative.<\/p>\n<p>So the LeakyReLU following the BN layer will still receive negative values.<\/p>\n<\/p><\/div>\n<div class=\"mt24\"><\/div>\n<\/div>\n<p>            <span class=\"d-none\" itemprop=\"commentCount\"><\/span> <\/p><\/div>\n<\/div>\n<p>[ad_2]<\/p>\n<p>solved Is use of Leaky ReLu after Batch Normalization (BN) is useful <\/p>\n","protected":false},"excerpt":{"rendered":"<p>[ad_1] The BN layer tries to zero-mean its output by subtracting an expectation over inputs. So we can expect some of its output values to be negative. So the LeakyReLU following the BN layer will still receive negative values. [ad_2] solved Is use of Leaky ReLu after Batch Normalization (BN) is useful<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[320],"tags":[2302,2751,1173],"class_list":["post-21178","post","type-post","status-publish","format-standard","hentry","category-solved","tag-deep-learning","tag-keras","tag-machine-learning"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v26.5 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>[Solved] Is use of Leaky ReLu after Batch Normalization (BN) is useful - JassWeb<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/jassweb.com\/solved\/solved-is-use-of-leaky-relu-after-batch-normalization-bn-is-useful\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"[Solved] Is use of Leaky ReLu after Batch Normalization (BN) is useful - JassWeb\" \/>\n<meta property=\"og:description\" content=\"[ad_1] The BN layer tries to zero-mean its output by subtracting an expectation over inputs. So we can expect some of its output values to be negative. So the LeakyReLU following the BN layer will still receive negative values. [ad_2] solved Is use of Leaky ReLu after Batch Normalization (BN) is useful\" \/>\n<meta property=\"og:url\" content=\"https:\/\/jassweb.com\/solved\/solved-is-use-of-leaky-relu-after-batch-normalization-bn-is-useful\/\" \/>\n<meta property=\"og:site_name\" content=\"JassWeb\" \/>\n<meta property=\"article:published_time\" content=\"2022-11-12T06:25:11+00:00\" \/>\n<meta name=\"author\" content=\"Kirat\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Kirat\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/jassweb.com\/solved\/solved-is-use-of-leaky-relu-after-batch-normalization-bn-is-useful\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/jassweb.com\/solved\/solved-is-use-of-leaky-relu-after-batch-normalization-bn-is-useful\/\"},\"author\":{\"name\":\"Kirat\",\"@id\":\"https:\/\/jassweb.com\/solved\/#\/schema\/person\/65c9c7b7958150c0dc8371fa35dd7c31\"},\"headline\":\"[Solved] Is use of Leaky ReLu after Batch Normalization (BN) is useful\",\"datePublished\":\"2022-11-12T06:25:11+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/jassweb.com\/solved\/solved-is-use-of-leaky-relu-after-batch-normalization-bn-is-useful\/\"},\"wordCount\":64,\"publisher\":{\"@id\":\"https:\/\/jassweb.com\/solved\/#organization\"},\"keywords\":[\"deep-learning\",\"keras\",\"machine-learning\"],\"articleSection\":[\"Solved\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/jassweb.com\/solved\/solved-is-use-of-leaky-relu-after-batch-normalization-bn-is-useful\/\",\"url\":\"https:\/\/jassweb.com\/solved\/solved-is-use-of-leaky-relu-after-batch-normalization-bn-is-useful\/\",\"name\":\"[Solved] Is use of Leaky ReLu after Batch Normalization (BN) is useful - JassWeb\",\"isPartOf\":{\"@id\":\"https:\/\/jassweb.com\/solved\/#website\"},\"datePublished\":\"2022-11-12T06:25:11+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/jassweb.com\/solved\/solved-is-use-of-leaky-relu-after-batch-normalization-bn-is-useful\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/jassweb.com\/solved\/solved-is-use-of-leaky-relu-after-batch-normalization-bn-is-useful\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/jassweb.com\/solved\/solved-is-use-of-leaky-relu-after-batch-normalization-bn-is-useful\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/jassweb.com\/solved\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"[Solved] Is use of Leaky ReLu after Batch Normalization (BN) is useful\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/jassweb.com\/solved\/#website\",\"url\":\"https:\/\/jassweb.com\/solved\/\",\"name\":\"JassWeb\",\"description\":\"Build High-quality Websites\",\"publisher\":{\"@id\":\"https:\/\/jassweb.com\/solved\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/jassweb.com\/solved\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/jassweb.com\/solved\/#organization\",\"name\":\"Jass Web\",\"url\":\"https:\/\/jassweb.com\/solved\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/jassweb.com\/solved\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/jassweb.com\/wp-content\/uploads\/2021\/02\/jass-website-logo-1.png\",\"contentUrl\":\"https:\/\/jassweb.com\/wp-content\/uploads\/2021\/02\/jass-website-logo-1.png\",\"width\":693,\"height\":132,\"caption\":\"Jass Web\"},\"image\":{\"@id\":\"https:\/\/jassweb.com\/solved\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/jassweb.com\/solved\/#\/schema\/person\/65c9c7b7958150c0dc8371fa35dd7c31\",\"name\":\"Kirat\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/jassweb.com\/solved\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/jassweb.com\/solved\/wp-content\/litespeed\/avatar\/1261af3c9451399fa1336d28b98ea3bb.jpg?ver=1776403586\",\"contentUrl\":\"https:\/\/jassweb.com\/solved\/wp-content\/litespeed\/avatar\/1261af3c9451399fa1336d28b98ea3bb.jpg?ver=1776403586\",\"caption\":\"Kirat\"},\"sameAs\":[\"http:\/\/jassweb.com\"],\"url\":\"https:\/\/jassweb.com\/solved\/author\/jaspritsinghghumangmail-com\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"[Solved] Is use of Leaky ReLu after Batch Normalization (BN) is useful - JassWeb","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/jassweb.com\/solved\/solved-is-use-of-leaky-relu-after-batch-normalization-bn-is-useful\/","og_locale":"en_US","og_type":"article","og_title":"[Solved] Is use of Leaky ReLu after Batch Normalization (BN) is useful - JassWeb","og_description":"[ad_1] The BN layer tries to zero-mean its output by subtracting an expectation over inputs. So we can expect some of its output values to be negative. So the LeakyReLU following the BN layer will still receive negative values. [ad_2] solved Is use of Leaky ReLu after Batch Normalization (BN) is useful","og_url":"https:\/\/jassweb.com\/solved\/solved-is-use-of-leaky-relu-after-batch-normalization-bn-is-useful\/","og_site_name":"JassWeb","article_published_time":"2022-11-12T06:25:11+00:00","author":"Kirat","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Kirat"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/jassweb.com\/solved\/solved-is-use-of-leaky-relu-after-batch-normalization-bn-is-useful\/#article","isPartOf":{"@id":"https:\/\/jassweb.com\/solved\/solved-is-use-of-leaky-relu-after-batch-normalization-bn-is-useful\/"},"author":{"name":"Kirat","@id":"https:\/\/jassweb.com\/solved\/#\/schema\/person\/65c9c7b7958150c0dc8371fa35dd7c31"},"headline":"[Solved] Is use of Leaky ReLu after Batch Normalization (BN) is useful","datePublished":"2022-11-12T06:25:11+00:00","mainEntityOfPage":{"@id":"https:\/\/jassweb.com\/solved\/solved-is-use-of-leaky-relu-after-batch-normalization-bn-is-useful\/"},"wordCount":64,"publisher":{"@id":"https:\/\/jassweb.com\/solved\/#organization"},"keywords":["deep-learning","keras","machine-learning"],"articleSection":["Solved"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/jassweb.com\/solved\/solved-is-use-of-leaky-relu-after-batch-normalization-bn-is-useful\/","url":"https:\/\/jassweb.com\/solved\/solved-is-use-of-leaky-relu-after-batch-normalization-bn-is-useful\/","name":"[Solved] Is use of Leaky ReLu after Batch Normalization (BN) is useful - JassWeb","isPartOf":{"@id":"https:\/\/jassweb.com\/solved\/#website"},"datePublished":"2022-11-12T06:25:11+00:00","breadcrumb":{"@id":"https:\/\/jassweb.com\/solved\/solved-is-use-of-leaky-relu-after-batch-normalization-bn-is-useful\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/jassweb.com\/solved\/solved-is-use-of-leaky-relu-after-batch-normalization-bn-is-useful\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/jassweb.com\/solved\/solved-is-use-of-leaky-relu-after-batch-normalization-bn-is-useful\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/jassweb.com\/solved\/"},{"@type":"ListItem","position":2,"name":"[Solved] Is use of Leaky ReLu after Batch Normalization (BN) is useful"}]},{"@type":"WebSite","@id":"https:\/\/jassweb.com\/solved\/#website","url":"https:\/\/jassweb.com\/solved\/","name":"JassWeb","description":"Build High-quality Websites","publisher":{"@id":"https:\/\/jassweb.com\/solved\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/jassweb.com\/solved\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/jassweb.com\/solved\/#organization","name":"Jass Web","url":"https:\/\/jassweb.com\/solved\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/jassweb.com\/solved\/#\/schema\/logo\/image\/","url":"https:\/\/jassweb.com\/wp-content\/uploads\/2021\/02\/jass-website-logo-1.png","contentUrl":"https:\/\/jassweb.com\/wp-content\/uploads\/2021\/02\/jass-website-logo-1.png","width":693,"height":132,"caption":"Jass Web"},"image":{"@id":"https:\/\/jassweb.com\/solved\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/jassweb.com\/solved\/#\/schema\/person\/65c9c7b7958150c0dc8371fa35dd7c31","name":"Kirat","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/jassweb.com\/solved\/#\/schema\/person\/image\/","url":"https:\/\/jassweb.com\/solved\/wp-content\/litespeed\/avatar\/1261af3c9451399fa1336d28b98ea3bb.jpg?ver=1776403586","contentUrl":"https:\/\/jassweb.com\/solved\/wp-content\/litespeed\/avatar\/1261af3c9451399fa1336d28b98ea3bb.jpg?ver=1776403586","caption":"Kirat"},"sameAs":["http:\/\/jassweb.com"],"url":"https:\/\/jassweb.com\/solved\/author\/jaspritsinghghumangmail-com\/"}]}},"_links":{"self":[{"href":"https:\/\/jassweb.com\/solved\/wp-json\/wp\/v2\/posts\/21178","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/jassweb.com\/solved\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/jassweb.com\/solved\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/jassweb.com\/solved\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/jassweb.com\/solved\/wp-json\/wp\/v2\/comments?post=21178"}],"version-history":[{"count":0,"href":"https:\/\/jassweb.com\/solved\/wp-json\/wp\/v2\/posts\/21178\/revisions"}],"wp:attachment":[{"href":"https:\/\/jassweb.com\/solved\/wp-json\/wp\/v2\/media?parent=21178"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/jassweb.com\/solved\/wp-json\/wp\/v2\/categories?post=21178"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/jassweb.com\/solved\/wp-json\/wp\/v2\/tags?post=21178"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}