Viewing a single comment thread. View all comments

incrediblereddit t1_j5yube5 wrote

Reply to comment by BrendanKML in Why add bias instead of subtracting bias? by ArthurLCTTheCool

Yes. Adding negative bias is same as subtraction, so to say, similarly subtracting negative bias is like addition. Ultimately it doesn't make a difference.

7

ArthurLCTTheCool OP t1_j5yuwla wrote

Yeah I get that but if you add a positive bias?

0

incrediblereddit t1_j5yyqnn wrote

While training the model, bias will be trained accordingly. Suppose ideal bias value is +x, if you are subtracting the bias instead of +x bias value will become -x, so overall w -(-x) will become w+x and vice versa.

3