Navigate to the BP_PlayerInventoryComponent then open the Spawn Held Actor collapsed graph. Then move the Server Reset Spawn event call to the end of the graph and reconnect its last place. As shown in the gifs below (The Server Reset Spawn event call is just before the delay node near the end of the graph).

https://gyazo.com/8da9205a42fb758861f8fd966c5959eb

https://gyazo.com/3fc7221bec3d95aa03bf7cc3dfe3aa55