This solution will work, but you have to be accurate with it. Below is a brief example of how I think you should do it.
Essentially you will need 5 tMap variables; val1, val2, val3, val4, average. They must be in that order from top to bottom. The value expressions will be (ignore the text in bold, that is just identifying the variable the value expression applies to)....
val1 = Var.val2
val2 = Var.val3
val3 = Var.val4
val4 = row1.value
average = Var.val1!=null ? (Var.val1+Var.val2+Var.val3+Var.val4)/4 : 0
Here is a screenshot of a tMap I have quickly set up to demonstrate this...
Keep in mind that for the first 3 values a 0 will be output as the average. This is because there are not 4 values to divide by 4 until the fourth value. This can be changed to whatever logic you want, I just chose this arbitrarily.