typeerror - "UnboundLocalError: local variable 'reward_n' referenced before assingment" In OpenAI Python Scripts -


i stuck on error after following tutorial online explaining concepts of writing openai scripts in python. complete error is:

typeerror: local variable 'reward_n' referenced before assignment

this current code:

import gym import random  #reinforcement learning step def determine_turn(turn, observation_n, j, total_sum, prev_total_sum, reward_n):     #for every 15 iterations, sum total observations, , take average     #if lower 0, change direction     #if go 15+ iterations , reward each step, we're doing right     #thats when turn     if(j >= 15):         if(total_sum/ j ) == 0:             turn = true         else:             turn = false          #reset vars         total_sum = 0         j = 0         prev_total_sum = total_sum         total_sum = 0      else:         turn = false     if(observation_n != none):         #increment counter , reward sum         j+=1         total_sum += reward_n     return(turn, j, total_sum, prev_total_sum)  def main():      #init environment     env = gym.make('cartpole-v0')     observation_n = env.reset()      #init variables     # num of game iterations     n = 0     j = 0     #sum of observations     total_sum = 0     prev_total_sum = 0     turn = false      #define our turns or keyboard actions     left = 0     right = 1     forward = env.action_space.sample()      #main logic     while true:         #increment counter number of iterations         n+=1          #if @ least 1 iteration made, check if turn needed         if(n > 1):             #if @ least 1 iteration, check if turn             if(observation_n[0] != none):                 #store reward in previous score                 prev_score = reward_n[0]                  #should turn?                 if(turn):                     #pick random event                     #where turn?                      event = random.choice([left,right])                     #perform action                     action_n = [event ob in observation_n]                     #set turn false                     turn = false          elif(~turn):             #if no turn needed, go straight             action_n = [forward ob in observation_n]           #if there obseravtion, game has started, check if turn needed         if(observation_n[0] != none):             turn, j, total_sum, prev_total_sum = determine_turn(turn, observation_n[0], j, total_sum, prev_total_sum, reward_n[0])          #save new variables each iteration         observation_n, reward_n, done_n, info = env.step(action_n)          env.render()  if __name__ == '__main__':     main()

the thing not error variables in main() or in determine turn gets variables main(). far knowledge of error , appreciate help.

#if @ least 1 iteration made, check if turn needed     if(n > 1):         #if @ least 1 iteration, check if turn         if(observation_n[0] != none):             #store reward in previous score             prev_score = reward_n[0]

in part of code trying access reward_n[0], variable has not initialized yet, so, need initialize before first call same way did this:

observation_n = env.reset()

Comments

Post a Comment

Popular posts from this blog

android - InAppBilling registering BroadcastReceiver in AndroidManifest -

i'm implementing inapp billing in android app. works well, however, i'm trying decouple broadcast receiver activity manifest. suggestion in android's trivialdrive sample: // important: dynamically register broadcast messages updated purchases. // register receiver here instead of <receiver> in manifest // because call getpurchases() @ startup, therefore can ignore // broadcasts sent while app isn't running. // note: registering listener in activity bad idea, done here // because sample. regardless, receiver must registered after // iabhelper setup, before first call getpurchases(). currently there's class extends broadcastreceiver : public class iabbroadcastreceiver extends broadcastreceiver { /** * intent action receiver should filter for. */ public static final string action = "com.android.vending.billing.purchases_updated"; private final iabbroadcastlistener mlistener; public iabbroadcastreceiver(iabbroadcastlistener listener) { m...
Read more

python Tkinter Capturing keyboard events save as one single string -

is possible store keyboard events 1 string? code below stores 1 char , prints it. card reader or bar code reader, contains collection of character/ string not 1 character @ time. goal save char pressed text variable. from tkinter import * root = tk() def key(event): text= event.char text+= event.char print ("pressed", text) def callback(event): frame.focus_set() print ("clicked at", event.x, event.y) frame = frame(root, width=100, height=100) frame.bind("<key>", key) frame.bind("<button-1>", callback) frame.pack() root.mainloop() currently, creating text variable , everytime key() function gets called, , text stores last character typed. you can define text module level variable , , use module level text inside key function - text = '' def key(event): global text text+= event.char print("pressed", text)
Read more

sql server - Why does Linq-to-SQL add unnecessary COUNT()? -

here tables: create table customer ( cid int primary key, name varchar(32) ) create table ord ( oid int primary key, cid int foreign key references customer, address varchar(20) ) here's linq-to-sql statement: var aaa = c in db.customer select new { c, o = c.ord.tolist() }; and here's inexplicable query generated linq-to-sql: select [t0].[cid] [cid], [t0].[name] [name], [t1].[oid] [oid], [t1].[cid] [cid2], [t1].[address] [address], (select count(*) [dbo].[ord] [t2] [t2].[cid] = [t0].[cid]) [value] [dbo].[customer] [t0] left outer join [dbo].[ord] [t1] on [t1].[cid] = [t0].[cid] order [t0].[cid], [t1].[oid] i want understand how rid of count(*) part. it's entirely uncalled for! linq needs count(*) in order determine number of entries returned o = c.ord.tolist() .
Read more