frozen – Yair Shinar

Tensorflow Graph Optimizing

On: October 6, 2019

In: AI, Computer Vision, Deep Machine Learning, NLP, Reinforcement Learning

After training we can optimize a frozen graph or even a dynamic graph by removes training-specific and debug-specific nodes, fusing common operations, and removes code that isn’t used/reached. Code Example from tensorflow.python.tools import optimize_for_inference_lib inputGraph = tf.GraphDef() #read in a frozen model with tf.gfile.Open(‘frozentensorflowModel.pb’, “rb”) as f: data2read = f.read() inputGraph.ParseFromString(data2read) outputGraph = optimize_for_inference_lib.optimize_for_inference(inputGraph, [“inputTensor”], Continue Reading

Tensorflow – Graph Freezing

On: October 2, 2019

In: AI, Computer Vision, Deep Machine Learning, NLP, Reinforcement Learning

In prediction/inference mode, variable types are unnecessary, so by freezing the graph we convert all variables in a graph and checkpoint into constants. Also there are structure nodes and operations related to training that we don’t need and can be removed by the freezing process as well. The freezing processContinue Reading