InvalidLogResponseException: The response sent back from the logging server was an error. Message: An unhandled exception occured in procedure GetBuildHistory : Out of memory

One of our build servers started throwing this error today. We keep the hard drive space and free memory and both are fine. any ideas? Maybe the logs are too big?


Date & Time:4/25/2013 11:32:04 AM
Operating System:Microsoft Windows NT 6.1.7601 Service Pack 1
System Up-time:1.21:02:53.6310000
Processor Count:8
Available Memory:7774 MB
Disk Usage:162.0367 GB/279.2969 GB (NTFS)
Version:7.0.0.324


Exception
---------

Type:System.ArgumentException
Message:Error serializing value ‘VSoftTechnologies.FinalBuilderServer.Log.InvalidLogResponseException: The response sent back from the logging server was an error. Message: An unhandled exception occured in procedure GetBuildHistory : Out of memory

Server stack trace:
at VSoftTechnologies.FinalBuilderServer.Log.LogReply1.CreateValue(Byte&#91;&#93; reply) <br> at VSoftTechnologies.FinalBuilderServer.Log.LogReply1…ctor(Byte[] reply)
at VSoftTechnologies.FinalBuilderServer.Log.Connection.Pipe.PipeConnection.SendRequest[T](LogRequest request)
at VSoftTechnologies.FinalBuilderServer.Log.LogSession.GetBuildHistory(String projectId, Boolean includeDeleted, Int32 start, Int32 pageSize)
at VSoftTechnologies.FinalBuilderServer.FBServerManager.GetBuildHistory(String projectName, Boolean includeDeleted, Int32 start, Int32 pageSize)
at System.Runtime.Remoting.Messaging.StackBuilderSink._PrivateProcessMessage(IntPtr md, Object[] args, Object server, Int32 methodPtr, Boolean fExecuteInContext, Object[]& outArgs)
at System.Runtime.R…’ of type ‘VSoftTechnologies.FinalBuilderServer.Log.InvalidLogResponseException.’
Stack Trace: at System.Web.UI.ObjectStateFormatter.SerializeValue(SerializerBinaryWriter writer, Object value)
at System.Web.UI.ObjectStateFormatter.Serialize(Object stateGraph)
at System.Web.UI.Util.SerializeWithAssert(IStateFormatter formatter, Object stateGraph)
at System.Web.UI.HiddenFieldPageStatePersister.Save()
at System.Web.UI.Page.SaveAllState()
at System.Web.UI.Page.ProcessRequestMain(Boolean includeStagesBeforeAsyncPoint, Boolean includeStagesAfterAsyncPoint)

Inner Exception
---------------

Type:System.IO.FileNotFoundException
Message:Could not load file or assembly ‘SmartAssembly.Attributes, Version=5.0.0.0, Culture=neutral, PublicKeyToken=7f465a1c156d4d57’ or one of its dependencies. The system cannot find the file specified.
Stack Trace: at System.ModuleHandle.ResolveType(Int32 typeToken, RuntimeTypeHandle* typeInstArgs, Int32 typeInstCount, RuntimeTypeHandle* methodInstArgs, Int32 methodInstCount)
at System.ModuleHandle.ResolveTypeHandle(Int32 typeToken, RuntimeTypeHandle[] typeInstantiationContext, RuntimeTypeHandle[] methodInstantiationContext)
at System.Reflection.Module.ResolveType(Int32 metadataToken, Type[] genericTypeArguments, Type[] genericMethodArguments)
at System.Reflection.CustomAttribute.FilterCustomAttributeRecord(CustomAttributeRecord caRecord, MetadataImport scope, Assembly& lastAptcaOkAssembly, Module decoratedModule, MetadataToken decoratedToken, RuntimeType attributeFilterType, Boolean mustBeInheritable, Object[] attributes, IList derivedAttributes, RuntimeType& attributeType, RuntimeMethodHandle& ctor, Boolean& ctorHasParameters, Boolean& isVarArg)
at System.Reflection.CustomAttribute.GetCustomAttributes(Module decoratedModule, Int32 decoratedMetadataToken, Int32 pcaCount, RuntimeType attributeFilterType, Boolean mustBeInheritable, IList derivedAttributes)
at System.Reflection.CustomAttribute.GetCustomAttributes(RuntimeType type, RuntimeType caType, Boolean inherit)
at System.ComponentModel.ReflectTypeDescriptionProvider.ReflectGetAttributes(Type type)
at System.ComponentModel.ReflectTypeDescriptionProvider.ReflectedTypeData.GetAttributes()
at System.ComponentModel.TypeDescriptor.TypeDescriptionNode.DefaultTypeDescriptor.System.ComponentModel.ICustomTypeDescriptor.GetAttributes()
at System.ComponentModel.TypeDescriptor.GetAttributes(Type componentType)
at System.ComponentModel.ReflectTypeDescriptionProvider.ReflectedTypeData.GetConverter(Object instance)
at System.ComponentModel.TypeDescriptor.TypeDescriptionNode.DefaultTypeDescriptor.System.ComponentModel.ICustomTypeDescriptor.GetConverter()
at System.ComponentModel.TypeDescriptor.GetConverter(Type type)
at System.Web.UI.ObjectStateFormatter.SerializeValue(SerializerBinaryWriter writer, Object value)

Hi

We have not been able to reproduce this here after we had another report of this issue recently. We did make some changes to the log server which we hope might resolve the problem, but since we’ve not bee able to reproduce the problem it’s not possible to be sure it’s resolved. This build has those changes :

http://downloads.finalbuilder.com/downloads/finalbuilderserver/700/FBServer_7.0.0.366.exe

We have been running with these changes for the last month without any issues.

our log fail was around 38GB when things started to fail. Stopping services and renaming the log to .old fixed the issue (it just created a new log file). This project has only been running about 8 months but has been ran 4000+ times. I’ve reduced the number of logs we keep and i will go through the project and hide unneeded log output.