lavfi/avfilter: remove now unused {src,cur,out}_buf.

This was supposed to be removed in 565e4993, but it was delayed due to
the port of the remaining filters. These buffer ref pointers are not
used anymore, thus dropped.